Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

# Neural dynamics of the attentional blink revealed by encoding orientation selectivity during rapid visual presentation

## Abstract

The human brain is inherently limited in the information it can make consciously accessible. When people monitor a rapid stream of visual items for two targets, they typically fail to see the second target if it occurs within 200–500 ms of the first, a phenomenon called the attentional blink (AB). The neural basis for the AB is poorly understood, partly because conventional neuroimaging techniques cannot resolve visual events displayed close together in time. Here we introduce an approach that characterises the precise effect of the AB on behaviour and neural activity. We employ multivariate encoding analyses to extract feature-selective information carried by randomly-oriented gratings. We show that feature selectivity is enhanced for correctly reported targets and suppressed when the same items are missed, whereas irrelevant distractor items are unaffected. The findings suggest that the AB involves both short- and long-range neural interactions between visual representations competing for access to consciousness.

## Introduction

Despite the remarkable capacity of the human brain, it is found wanting when undertaking multiple tasks concurrently, or when several goal-relevant items must be dealt with in rapid succession. These limitations are particularly evident when individuals are required to execute responses to multiple items under time pressure1,2, or when they must report relevant target items that appear briefly and in rapid succession3,4,5. Elucidating the source of these limitations has been a persistently difficult challenge in neuroscience and psychology. While the neural bases for these processing limits are not fully understood, it is widely assumed that they are adaptive because they provide a mechanism by which selected sensory events can gain exclusive control over the motor systems responsible for goal-directed action.

Here we address a long-standing question concerning the neural basis of the widely studied attentional blink (AB) phenomenon, where observers often fail to report the second of two target items (referred to as T2) when presented within 200–500 ms of the first target (T1) in a rapid stream of distractors3,4,5. Functional magnetic resonance imaging (fMRI) lacks the temporal resolution to accurately characterise neural activity associated with the rapid serial visual presentation (RSVP) tasks presented at rates of 8–12 Hz, which are commonly used to elicit the AB6,7. Even electroencephalography (EEG), which has relatively good temporal resolution, produces smeared responses to items in an RSVP stream8. Furthermore, mass-univariate approaches applied to fMRI or EEG data only measure overall neural activity while providing no information about how neural activity represents featural information carried by single items (e.g., their orientation).

Here we overcome these limitations by combining recently developed multivariate modelling techniques for neuroimaging9,10,11,12,13,14,15,16 with an RSVP task designed to determine the neural and behavioural basis for the AB. Forward (or inverted) encoding modelling determines the neural representation of feature-selective information contained within patterns of brain activity, using multivariate linear regression. This approach allowed us to explicitly measure the neural representation of specific features—in this case, orientation-selective information elicited by grating stimuli—separately for each item within an entire RSVP stream.

We use this approach to address two central theoretical questions. First, does selection of a target from within an RSVP stream increase the gain or the precision of its neural representation? Previous efforts to answer this question in the domain of spatial attention have come from single cell recordings in non-human primates17,18, as well as whole-brain activity measured using fMRI and EEG in humans15,19. With few exceptions, these studies have found that spatial attention increases the gain of feature-selective processing of attended items. By contrast, feature-based manipulations of attention, in which specific characteristics of an item such as its colour or motion are cued for selective report, typically result in a sharpening of neural selectivity20,21. To date, it remains unknown whether the limits of temporal attention in the AB are associated with changes in neural tuning to targets, distractors, or both classes of items. The neural response in human primary visual cortex6 and macaque lateral intraparietal area22 to the second target is reduced overall on AB trials compared with non-AB trials, while subtraction-based EEG designs have shown that a late-stage component of the ERP (the N400) is reduced 200–400 ms after target presentation8. Critically, however, these measures cannot determine how the AB affects the neural representation of visual information, which could conceivably reflect a reduction in gain, an increase in tuning sharpness, or both.

A second, unresolved theoretical question concerns the source of the AB. Existing theories have often attributed the AB to either extended processing of the first target, or to inadvertent distractor processing. In the first class of theories, it is assumed that all items generate representations in early visual areas, but that the system inhibits items after T1 detection to avoid contamination by distractors23,24,25,26. On other accounts (so-called ‘distractor-based’ theories), the AB is assumed to reflect a cost associated with switching between target and distractor processing27. Finally, a third class of theories argues that the representation of the second target can become merged with either the first target or the distractors28,29. This class of theories is motivated by the finding that the perceived order of targets is often reversed (i.e., T2 is reported as appearing before T1).

Our RSVP task consists of a stream of randomly oriented Gabor gratings, with two higher spatial-frequency targets set amongst lower-spatial-frequency distractors (Fig. 1a and Supplementary Movie 1). At the end of the stream, participants are asked to reproduce the orientations of the two targets (Fig. 1b). Critically, the orientation of each item in the stream is uncorrelated with the orientation of all other items (Fig. 1c), thus permitting the use of linear regression analyses to separately extract the influence of each item in the stream on neural activity measured by EEG, and on behavioural reports of the orientations of the two targets. These aspects of the experimental design allowed us to quantify the influence of both targets and distractors on participants’ perceptual reports and on their associated neural representations.

To preview the results, the behavioural target task replicated the hallmarks of the AB effect: the orientation of T1 was reported with a relatively high degree of accuracy, whereas orientation judgements for T2 were degraded when T2 appeared 200–400 ms after T1. Forward encoding analyses of EEG activity showed that targets evoked greater orientation-selective information than distractors when T2 was accurately reported (i.e., in non-AB trials), and that orientation information evoked by T2 was suppressed, relative to the distractors, when T2 was missed (i.e., in AB trials). Critical to our first question of whether focused attention influences the gain or precision of feature-specific representations, only the gain of the encoded EEG response was affected by T2 response accuracy.

With respect to our second question—whether accuracy in registering the second target is linked to the processing of T1 or to the intervening distractors—the evidence was in favour of T1-based theories of the AB. We found no evidence to suggest that neural representations of the distractors are affected by the AB. Finally, we describe an unexpected observation—one not predicted by any theory of the AB—namely, a significant interaction between the specific features of T1 and T2, implying a previously unknown long-range temporal integration of target representations within rapid sequential visual streams.

## Results

### Experiment 1—behavioural hallmarks of the AB

Participants’ (N = 22) response errors (i.e., the difference between the presented and reported orientation for each target) were centred around 0°, verifying that they were able to perform the task as instructed. Figure 2a captures the temporal dynamics of the AB, such that accuracy was affected by target position (T1 or T2) and Lag. Specifically, at Lag 1 accuracy for both T1 and T2 was degraded relative to accuracy at the other lags (2, 3, 5 and 7). Moreover, at Lags 2 and 3, T1 accuracy was high whereas T2 accuracy was relatively poor. This was largely due to an increase in the baseline guessing rates (where errors occurred evenly across all orientations). Finally, at longer temporal separations (Lags 5 and 7), target accuracy was similar for both items.

### Experiment 1—modelling the AB using behavioural data

We fitted Gaussian functions to each individual’s data to quantify how the AB affected target perception (Fig. 2b; see Methods and Supplementary Fig. 1). The accuracy reduction for T2 at Lags 2 and 3 was primarily linked to a reduction in gain. A 2 (Target; T1,T2) × 5 (Lag; 1,2,3,5,7) within-subjects ANOVA showed the gain parameter was affected by Target (F(1,21) = 10.00, p = 0.005, ηp2 = 0.32) and Lag (F(4,84) = 11.66, p < 0.0001, ηp2 = 0.36), and the interaction between these factors (F(4,84) = 7.10, p < 0.0001, ηp2 = 0.25). Critically for our first theoretical question, the spread (width) of orientation errors was unaffected by the factors of Target (F(1,21) = 0.10, p = 0.76, ηp2 = 0.005) or Lag (F(4,84) = 0.55, p = 0.70, ηp2 = 0.03), or by the interaction between these factors (F(4,84) = 0.19, p = 0.94, ηp2 = 0.01). The baseline parameter, which reflects guessing of random orientations, was also significantly affected by the factors of Target (F(1,21) = 12.72, p = 0.002, ηp2 = 0.38) and Lag (F(4,84) = 4.82, p = 0.002, ηp2 = 0.19), and by the interaction between them (F(4,84) = 5.04, p = 0.001, ηp2 = 0.19). These same effects were also evident when the data were not normalised (Supplementary Fig. 2), and with a wide range of parameters to specify the orientation errors (Supplementary Fig. 3).

Taken together, these results are consistent with a previous AB study using similar analysis methods30. They also lend weight to the global workspace theory of consciousness in the AB31, which argues that participants either see the target and have full awareness of it (allowing them to respond precisely), or they have no awareness (and so simply guess randomly). By contrast, the results are inconsistent with the opposing view that the AB involves a noisier (i.e., weaker precision) signal for the target that is inaccurately reported32.

### Experiment 1—targets, not distractors, influence orientation judgements

To evaluate the influence of distractors on participants’ reports, we aligned the orientations of the items relative to target position within the RSVP stream (−4 to +7 items) and constructed a regression matrix to predict the behavioural response for each target. If the orientation of an item is influential in determining the reported orientation, the regression weight will be relatively high (Fig. 2c). As expected, for all lags, each reported target orientation was influenced principally by its own orientation. The one exception was the item at Lag 1, where the reported orientation of T1 was as strongly influenced by the orientation of T2 as by the orientation of T1. This observation is in line with numerous studies which have suggested that temporal order information can be lost for consecutive targets29,33. This phenomenon, also known as Lag 1 switching, where the perceived order of the targets is reversed, explains why the accuracy of orientation judgements on both T1 and T2 was reduced at Lag 1 (see also Supplementary Fig. 4). By contrast, for items at Lags 2 and 3, orientation judgements on T1 were only marginally influenced by the orientation of T2 (i.e., for items at positions +2 and +3, respectively, in the RSVP stream). However, at these same lags (where the AB was maximal) T2 reports were significantly influenced by T1 orientation (i.e., for items at positions −2 and −3, respectively). Importantly, there was no reliable influence of distractors on reported target orientation at any lag, suggesting distractors played little or no role in target orientation errors.

### Experiment 1—long-range integration of target orientations

One account of the AB28,29 has suggested that successive targets presented at short lags are integrated into a single episodic trace, which accounts for Lag 1 switching. With the present task, we can directly quantify how targets are integrated by looking for systematic biases in the reported orientation of a given target based on its orientation difference with respect to the other target. Figure 3a shows orientation judgement errors as a function of the difference between the two target orientations. While the average orientation error is centred on 0°, the perceived orientation of either target (T1 or T2) was significantly biased toward the orientation of the other target within the RSVP stream at early Lags. Furthermore, these biases were orientation-tuned, such that the largest bias occurred when targets differed by approximately 45°, somewhat analogous to serial dependency effects34,35. This profile of biases suggests response integration, rather than replacement, as the latter would predict that only the orientation of T2 should drive the reported orientation of T1. Instead, and consistent with our linear regression analysis (see Fig. 2c), the bias reflected the difference between target orientations, which supports the idea that the critical features of the two targets are assimilated over time28,29.

We fit first derivative of Gaussian (D1) functions36,37,38 to quantify the amount of orientation-selective bias for both targets at each Lag for each participant. A 2 (Target; T1, T2) × 5 (Lag; 1,2,3,5,7) within-subjects ANOVA revealed significant main effects of Target (F(1,21) = 5.04, p = 0.04, ηp2 = 0.19) and Lag (F(4,84) = 6.54, p < 0.0001, ηp2 = 0.24), and a significant interaction (F(4,84) = 6.14, p < 0.0001, ηp2 = 0.27). For T1 reporting, the bias was significantly greater than chance at all intervals, whereas for T2, there was a significant bias at Lags 2 and 3 only (Bonferroni-corrected one-sample t-test, all ps < 0.05). As might be expected28,29, the ‘attraction’ bias in target reports was strongest when the two targets were presented with no intervening distractors between them (i.e., at Lag 1). An entirely unexpected finding, however, is that there was an equally strong attraction bias between targets presented at Lags 2 and 3 (see Fig. 3b), even though participants were not explicitly aware of the orientation of T2 on AB trials.

### Experiment 1—biased perception of targets by preceding distractors

Previous work suggests that distractor processing can significantly interfere with target processing39,40,41, particularly for the immediate post-target item which can be integrated into the target representation28,29,33. To determine whether this was the case in our data, we repeated the previous analysis but used the difference in orientation between the target and each of the other items in the RSVP stream (Fig. 3c). For most lags, the reported target orientation was significantly attracted toward the immediately following distractor, but was not reliably influenced by any other distractor. A 2 (Target; T1, T2) × 5 (Lag; 1,2,3,5,7) × 5 (Item position; −1,1,2,3,4) within-subjects ANOVA confirmed a significant three-way interaction between the factors (F(16,336) = 4.11, p < 0.0001, ηp2 = 0.16). At Lag 1, there was no influence of distractors on reported orientations for either T1 or T2. Taken with the previous result, this suggests that the representation of a given target is influenced by both the other target and by the post-target item. The results suggest that when the visual system detects a target, it automatically integrates features from the immediately subsequent item. This is consistent with previous studies that have highlighted the importance of masking by the item immediately following the target in eliciting the AB42.

### Experiment 2—electrophysiological recording of the AB

We next characterised the neural activity elicited by individual RSVP items, and determined how this was affected by the AB. In Experiment 2, a group of 23 new participants undertook the RSVP task introduced in Experiment 1 while neural activity was concurrently measured using EEG. The method was identical in all respects, except that we now included targets only at Lags 3 and 7 (i.e., a single target inside and outside the AB, respectively) to increase the within-subject power for the EEG analyses.

### Experiment 2—behavioural results

The behavioural results replicated, in all important respects, those found in Experiment 1. As shown in Fig. 4a, participants performed well overall, and their orientation judgements for T1 and T2 were centred on the presented orientations. As in Experiment 1, we fit Gaussian functions to quantify the results (Fig. 4b). For the gain parameter, a 2 (Target; T1, T2) × 2 (Lag; 3, 7) within-subjects ANOVA revealed significant main effects of Target (F(1,22) = 11.63, p = 0.003, ηp2 = 0.35) and Lag (F(1,22) = 18.70, p < 0.0001, ηp2 = 0.46), and a significant interaction (F(1,22) = 40.19, p < 0.0001, ηp2 = 0.65). Likewise for the baseline parameter, there were significant effects of Target (F(1,22) = 8.96, p = 0.007, ηp2 = 0.30) and Lag (F(1,22) = 12.21, p = 0.002, ηp2 = 0.36), and a significant interaction (F(1,22) = 7.91, p = 0.01, ηp2 = 0.26). By contrast, there were no significant main effects and no interaction for the width parameter (Target (F(1,22) = 1.19, p = 0.29, ηp2 = 0.05; Lag (F(1,22) = 3.90, p = 0.06, ηp2 = 0.15); interaction (F(1,22) = 0.14, p = 0.71, ηp2 = 0.006).

### Experiment 2—orientation selectivity of RSVP items

We next applied forward modelling to the EEG data recorded during the task to quantify orientation information contained within multivariate patterns of neural activity. Because the orientations of successive items were uncorrelated, we were able to quantify orientation selectivity for each grating without contamination from adjacent items. Forward encoding uses a linear regression-based approach to find multivariate patterns of EEG activity that are selective for features of interest—in this case orientation. As no previous study has used forward encoding in conjunction with rapid visual presentations, we first verified that orientation selectivity for each of the 20 RSVP items could be extracted separately using this approach, and at what time point any such response was evident. To do this, we constructed 20 encoding models, one for each of the item positions within the 20-item RSVP stream, based on the orientations presented for that item across trials.

As shown in Fig. 5, the forward encoding revealed robust and reliable feature selectivity derived from patterns of EEG activity for each of the gratings presented during the RSVP. Each item’s orientation was successfully decoded over a time window that extended from 74 to 398 ms after the item was presented. Examination of the neural responses to each of the 20 items within the RSVP stream (Fig. 5c) shows that feature selectivity was evident as a series of regularly spaced, short-lived impulse responses, each with a delay of around 50 ms from grating onset and lasting approximately 300 ms. To quantify these observations, we fit Gaussian functions to the forward encoding results for each item separately for each participant and at each time point. There was significant feature selectivity (given by the gain of the Gaussian) for each item immediately after it was presented but not before (Fig. 5d). These representations were temporally overlapping, such that multiple orientation-selective responses (~3) were detectable at the same time. Taken together, the forward encoding analyses verify that it is possible to reliably recover the presented orientation of every RSVP item from the multivariate pattern of neural activity recorded using EEG.

### Experiment 2—reduced feature-selective information for T2 during the AB

We next examined how neural representations of the target items were affected by the AB. To increase signal-to-noise for training the encoding model, we aligned the EEG data to the presentation time of each item in the RSVP stream and applied the same forward encoding procedure. This meant that the model was trained and tested across 12,000 presentations (600 trials by 20 RSVP items; see Fig. 6). To determine the effect of the AB on orientation-selectivity, we separated the forward encoding results by target (T1,T2) and T2 accuracy (correct, incorrect). For the purposes of the analyses, trials were scored as correct if the reported orientation was within ±30 degrees of the presented orientation, a criterion which yielded roughly equal correct and incorrect trials at Lag 3. In line with the AB literature, for all the EEG analyses we only included trials where participants correctly identified T1. Applying these criteria yielded the classic AB effect (Supplementary Fig. 5). A 2 (Lag; 3, 7) × 2 (Target; T1, T2) within-subjects ANOVA applied to these scores revealed significant main effects of Lag (F(1,22) = 19.05, p < 0.0001, ηp2 = 0.46) and Target (F(1,22) = 18.00, p < 0.0001, ηp2 = 0.45), and a significant interaction (F(1,22) = 31.91, p < 0.0001, ηp2 = 0.59). Follow-up t-tests showed that Lag 3 accuracy was significantly lower than Lag 7 accuracy for T2 items (t(22) = 5.20, Bonferroni p = 0.0001, d = 0.44) but not for T1 items (t(22) = 2.11, Bonferroni p = 0.09, d = 0.44). In addition, T2 accuracy was significantly lower than T1 accuracy at Lag 3 (t(22) = 5.94, Bonferroni p < 0.0001, d = 1.08), but there was no such difference at Lag 7 (t(22) = 1.20, Bonferroni p = 0.48, d = 0.25).

We again fitted Gaussians to each time point to quantify the amount of feature-selective information evoked by the targets. For both T1 and T2, there was significant feature-selective activity shortly after each item appeared (Fig. 6a). For Lags 3 and 7, there was no difference between correct and incorrect trials for the T1 representation. For T2, however, incorrect trials resulted in a significantly decreased feature-selective response (cluster p = 0.02) relative to correct trials shortly after each item appeared (100–150 ms) at Lag 3, although the response was not completely suppressed. There were no significant differences in the orientation-selective response between correct and incorrect trials for T2 at Lag 7, suggesting the suppression is caused by the AB rather than general target detection. This was expected because the AB typically lasts less than 500 ms, and is consistent with the current behavioural results showing an AB at Lag 3 but not at Lag 7. Performing the same analysis on the other parameters of the Gaussian (width, centre, baseline) showed no effect of the AB (Supplementary Fig. 6).

To ensure we did not miss any small but consistent effects, we averaged the forward encoding results (Orientation × Time) over the early (100–150 ms) timepoints to increase signal-to noise-ratio and recovered the orientation tuning curve (Fig. 6b). Fitting Gaussians to these values confirmed that the AB was associated with a change in the gain of feature selectivity for T2 at Lag 3, such that correct trials showed significantly greater gain than incorrect trials (t(22) = 3.12, p = 0.01, d = 0.65; Fig. 6b upper panel). By contrast, the width of the representation was again unaffected by the AB (t(22) = 1.66, p = 0.11, d = 0.35) for the same item. For Lag 7 items, neither the gain (t(22) = 0.12, p = 0.90, d = 0.03; Fig. 6b lower panel) nor the width (t(22) = 0.04, p = 0.96, d = 0.01) of the neural representations of T2 items were affected by behavioural performance (correct vs. incorrect trials).

The reduction in T2 selectivity for incorrect trials at Lag 3 was not driven by an arbitrary split of trials into correct and incorrect categories. To verify this, we sorted the evoked T2 forward encoding results by the amount of orientation error (in 15º error bins to allow sufficient signal-to-noise ratios for fitting). There was significantly greater feature selectivity when the orientation error was small, and this selectivity gradually decreased with larger errors (one-way within-subjects ANOVA, F(1,22) = 2.76, p = 0.02, ηp2 = 0.11; Fig. 7). Note that this finding is inconsistent with a graded model of the AB, and instead supports the idea that response variability during the AB is associated with both a decrease in feature-selective gain and an increase in the rate of guessing. This finding is consistent with the behavioural results, which suggest a discrete model of the AB. Overall, these results indicate that the AB is associated with a reduction in gain, but not width, of feature-selective information for the second target item (T2), and that this effect occurs soon after the target appears within the RSVP stream.

### Experiment 2—only targets affect the AB, but not distractors

We next examined the neural representations both of targets and distractors to test the different predictions made by T125,26- versus distractor-based27 accounts of the AB. T1-based accounts argue that the second target deficit is caused by extended processing of the first target, whereas distractor-based accounts, argue that deleterious processing of the distractors, mainly between T1 and T2, causes the second target to be missed. The theories thus make distinct predictions about the neural representation of target and distractor items. According to T1-based accounts, target representations should be enhanced relative to those of distractors, and missed T2 items on AB trials should be more poorly represented than correctly reported T2 items. By contrast, distractor-based accounts predict that neural representations of distractor items should be stronger on AB trials than on non-AB trials and weaker following T1 presentation.

As before, we averaged the forward encoding modelling representations (Orientation × Time) across an early time point (100 to 150 ms), and fit Gaussians to each participant’s data to quantify feature selectivity (Fig. 8a). For correct trials (i.e., orientation responses to T2 were within 30° of the presented orientation), the two targets resulted in significantly higher feature selectivity (gain) than the immediately adjacent distractors (−2, −1, +1 and +2 items) for both T1 and T2 representations (all ps < 0.04). On incorrect trials, feature selectivity for T1 was not significantly greater than selectivity for the surrounding distractors (t(22) = 0.15, p = 0.88, d = 0.03), even though we included only trials in which T1 was correctly reported. Most interestingly, on incorrect trials the representations of T2 items were significantly lower than those of the immediately adjacent distractors (t(22) = 2.09, p = 0.04, d = 0.44), suggesting that the featural information carried by T2 was suppressed, while distractors were unaffected. To directly test the distractor model of the AB, we compared distractor representations before T1 with distractor representations during the AB (i.e., between T1 and T2). The account predicts that distractors presented during the AB should elicit a stronger neural representation as they are likely to be incorrectly selected as targets. Instead, we found that distractors were represented similarly before and during the AB for both correct trials (t(22) = 0.85, p = 0.40, d = 0.18) and incorrect trials (t(22) = 1.83, p = 0.08, d = 0.38).Taken together, these results suggest that for trials where participants accurately report target orientation, the neural representations of targets are boosted relative to those of distractors. By contrast, when the second target is missed, as occurs during the AB, there is a significant suppression of the target’s featural information.

### Experiment 2—localisation of feature selectivity for targets and distractors

In a final step, we performed a univariate sensor-level analysis for feature selectivity10 to find the topographies associated with target and distractor processing. To do this, we trained a simplified model of feature selectivity on each type of item (targets and distractors) separately for each EEG sensor. Orientation information for both targets and distractors was evident most strongly over occipital and parietal areas, and target items generated significantly greater selectivity over these areas than distractors (Fig. 8b). These findings suggest that while target and distractor items are processed in overlapping brain regions, targets generate significantly greater orientation-selective information than distractors.

## Discussion

We developed an RSVP paradigm to determine the neural and behavioural bases of the limits of temporal attention. The behavioural results replicated the hallmark of the AB with response accuracy being significantly reduced when T2 was presented within 200–400 ms of T1. We discovered that target representations influenced one another, such that the reported orientation of one target was biased toward the orientation of the other. Results from Experiment 2 revealed that successfully reporting T2 depended on a boost to its neural representation relative to other items in the RSVP stream, whereas missing T2 corresponded to a suppressed neural response relative to the distractors. Notably, there was no evidence for suppression of neural representations of the distractors, suggesting the AB is primarily driven by processing competition between target items. This observation supports theories that have attributed the second-target deficit to first target processing4,23,43, but is inconsistent with theories that attribute the AB to inadvertent processing of distractor items24,27.

An important but unexpected result is that target reports were influenced by one another despite being separated by several hundred milliseconds and multiple distractor items. One influential theory argues that the AB is caused by temporal integration of the target with the immediate post-target distractor28,29. Our RSVP task found evidence for this but also showed that target representations appear to be integrated with each other even when they are separated by multiple distractor items within the stream. This finding is not explicitly predicted by any existing account of the AB. The largest bias was for Lag 1 trials, in which the two targets appear sequentially, a result that is consistent with Lag 1 switching28,29,33. The orientation of the immediate post-target distractor also significantly biased the perceived target orientation, whereas the distractors that appeared between the targets did not bias perceptual judgements. Taken together, our findings across two experiments suggest that the detection of a target in an RSVP sequence starts a period of local integration which involuntarily captures the next item, whether it is a target or a distractor. This is followed by a more global integration of targets, possibly within working memory4.

Our first major aim was to determine how the AB affects target representations. The forward encoding modelling of the EEG data adds to previous results30 by demonstrating that the gain in neural representations of Lag 3 items is significantly reduced in AB trials, compared with non-AB trials. Supporting the behavioural results, there was no effect on the width of EEG-derived feature selectivity during the AB. The neural results also go beyond the behavioural findings by showing that the gain of Lag 3 items is not only suppressed on AB trials, but boosted on non-AB trials compared with those of the distractors. Taken together, these results suggest that temporal attention operates in a similar manner to spatial attention15,17,18,19, but not to feature-based attention20,21, as the former has been found to affect the gain of neural responses whereas the latter tends to affect the sharpness of neural tuning.

The second major aim of our study was to resolve the persistent debate between T1- and distractor-based theories of the AB4,23,24,25,26,27,43,44. Behaviourally, we found scant evidence that distractors (apart from the immediately subsequent distractor) influence target perception. Consistent with T1-based accounts of the AB4,25, there were robust neural representations of distractors and no evidence that distractor representations were boosted following initial target detection, as would be predicted by distractor-based accounts. Furthermore, we found no evidence that post-T1 distractors were suppressed, as would be predicted by T1-based inhibition accounts of the AB4,23. Instead, consistent with T1-based accounts, the representations of both targets were boosted relative to those of the distractors. If the second target was missed, however—as occurs during the AB—then the representation of the second target was significantly suppressed relative to the distractors. Taken together, these results suggest that when the first target is processed rapidly, attention is efficiently redeployed to the second target, causing its representation to be boosted. By contrast, if the second target appears while processing of the first target is ongoing, the visual system actively suppresses the information to avoid the targets interfering with each other.

Suppression of the T2 representation occurred 100–150 ms after the target appeared, suggesting inhibition of the sensory information by ongoing processing of T1. This fits well with previous work showing that the AB is associated with a reduced late-stage response, as indicated by an ERP component associated with working memory consolidation8,45. Taken together with the current results, it appears that the AB is associated with an early suppression of sensory information associated with the T2 stimulus. The diminished strength of sensory information associated with the T2 item in turn is expected to exert less influence on later stages in the information processing hierarchy, such as working memory. This could also explain why the T2 representation was only initially affected (100–150 ms), as only its early appearance needs to be suppressed to stop inference with T1 processing at a higher stage. These behavioural results may be consistent with sequential working memory consolidation of targets. We found the precision of reporting T1 was unaffected by Lag, even though often during the AB only one item is reported, whereas at longer lags two items are reported. During spatial working memory tasks, where multiple items are simultaneously presented, longer lags should have a higher memory load and lead to lower precision46. Instead, the current results suggest that each target is consolidated into working memory before the store allows a second item to enter.

In summary, the current work adds to our understanding of the neural and behavioural basis of temporal attention. We were able to recover a neural signature for each item within an RSVP stream, something that has not been possible with conventional approaches to EEG and fMRI data. Our methodology indicated that while there is co-modulation of featural information carried by each of the targets, there is no evidence for distractor suppression in this RSVP task. We also document the existence of interactions among targets that are separated by several hundred milliseconds.

Our methodology provides a rich framework for exploring the neural bases of many psychological phenomena, including repetition blindness47 and contingent attentional capture48. The current work was not designed to pinpoint the exact neural locus of the AB, but combining our approach with a technique like fMRI, which has better spatial resolution than EEG, could elucidate some of the key brain areas involved in the phenomenon. It has been suggested that feedback and feedforward processes modulate different aspects of the AB49. Future studies might also fruitfully combine our method with invasive recordings across multiple brain sites in animal models, to better understand the neuronal mechanisms underlying the AB effect.

## Methods

### Participants

In Experiment 1, 22 participants (13 females, 9 males; median age 22 years; range 19–33 years) were recruited from a paid participant pool and reimbursed at AUD\$20/hr. In Experiment 2, 23 participants (14 females, 9 males; median age 23 years; range 19–33 years old) were recruited from the same pool and reimbursed at the same rate. Each person provided written informed consent prior to participation and had normal or corrected-to-normal vision. The study was approved by The University of Queensland Human Research Ethics Committee and was in accordance with the Declaration of Helsinki.

### Experimental setup

Both experiments were conducted inside a dimly illuminated room. The items were displayed on a 22-inch LED monitor (resolution 1920 × 1080 pixels, refresh rate 100 Hz) using the PsychToolbox presentation software for MATLAB50,51. In Experiment 1, participants were seated at a distance of approximately 45 cm from the monitor. In Experiment 2, the same viewing distance was maintained using a chinrest to minimise head motion artefacts in the EEG. At a viewing distance of 45 cm, the monitor subtended 61.18º × 36.87º (one pixel = 2.4′ × 2.4′).

A schematic of the task is shown in Fig. 1. Supplementary Movie 1 shows two example trials. Each trial began with a central fixation point and the RSVP stream commenced after 300 ms. The stream consisted of 20 Gabors (0.71° standard deviation, ~5° diameter, 100% contrast, centred at fixation) on a mid-grey background. On each trial, the orientations of the twenty Gabors in the stream were drawn pseudo-randomly, without replacement, from integer values ranging from 0–179°. Both targets and distractors were drawn from the same random distribution, meaning there was no restriction on the relationship between targets (except they could not be identical). Note the uncorrelated nature of the targets means the design controls for possible repetition blindness effects52, since the targets were equally likely to be similar in orientation as they were to be maximally dissimilar (i.e., orthogonal), and thus any potential orientation-specific effects would cancel out across trials.

Each item was presented for 40 ms and was separated from the next item by a blank interval of 80 ms, yielding an 8.33 Hz presentation rate. The participants’ task was to reproduce the orientations of the two high-spatial-frequency Gabors (targets; 2 c/°) while ignoring the items of a low-spatial frequency (distractors; 1 c/°). Between 4 and 8 distractors, varied pseudo-randomly on each trial, were presented before the first target (T1) to minimise the development of strong temporal expectations, which can reduce the AB40,53. The number of distractor items between T1 and T2 defined the inter-target lag (1,2,3,5,7 in Experiment 1, and 3,7 in Experiment 2). There were 600 trials in each of the two experiments, with an equal distribution of trials across the lag conditions (120 in Experiment 1, 300 in Experiment 2), with fewer lags included in Experiment 2 to increase signal to noise for the regression-based EEG analysis. In Experiment 2, we selected Lag 3 as the test condition for the AB because it yielded a significant reduction in T2 response accuracy compared with T1 in Experiment 1, and because it has been widely used in previous studies of the AB24,39,40,54,55,56,57.

Participants were asked to monitor the central RSVP stream until the presentation of the last Gabor, after which a response screen appeared (see Fig. 1b). The response screen consisted of a centrally presented black circle (10° diameter) and a yellow line. Participants rotated the line using a computer mouse to match the perceived orientation of the target and clicked to indicate their desired response. They were asked to reproduce the orientations of the two targets (T1, T2) in the order they were presented, and to respond as accurately as possible, with no time limit. After providing their responses, participants were shown a feedback screen which displayed their orientation judgements for T1 and T2, and the actual orientations of both targets (see Fig. 1c). The feedback was displayed for 500 ms before the next trial began, and participants were given a self-paced rest break every 40 trials. Each experiment took between 50 and 60 min to complete.

### EEG acquisition and pre-processing

In Experiment 2, continuous EEG data were recorded using a BioSemi Active Two system (BioSemi, Amsterdam, Netherlands). The signal was digitised at 1024 Hz sampling rate with a 24-bit A/D conversion. The 64 active scalp Ag/AgCl electrodes were arranged according to the international standard 10–20 system for electrode placement58 using a nylon head cap. As per BioSemi system design, the common mode sense and driven right leg electrodes served as the ground, and all scalp electrodes were referenced to the common mode sense during recording. Pairs of flat Ag-AgCl electro-oculographic electrodes were placed on the outside of both eyes, and above and below the left eye, to record horizontal and vertical eye movements, respectively.

Offline EEG pre-processing was performed using EEGLAB59 in accordance with best practice procedures60,61. The data were initially down sampled to 512 Hz and subjected to a 0.5 Hz high-pass filter to remove slow baseline drifts. Electrical line noise was removed using the clean_line, and clean_rawdata functions in EEGLAB was used to remove bad channels (identified using Artifact Subspace Reconstruction), which were then interpolated from the neighbouring electrodes. Data were then re-referenced to the common average before being epoched into segments for each trial (−0.5 s to 3.0 s relative to the first Gabor in the RSVP). Systematic artefacts from eye blinks, movements and muscle activity were identified using semi-automated procedures in the SASICA toolbox62 and regressed out of the signal. The data were then baseline corrected to the mean average EEG activity from 500 to 0 ms before the first Gabor in the trial.

### Behavioural analysis

To determine how the AB affected participants’ perception of targets, for each trial we found the difference between the actual target orientation and the reported orientation (i.e., the orientation error) for T1 and T2. This approach is analogous to one employed in previous work that examined whether the AB is associated with discrete or graded awareness of T230. The continuous nature of the orientation responses given by participants on each trial raises the challenge of distinguishing “correct” and “incorrect” trials. For Experiment 2, we scored trials as correct when the orientation error was less than 30° from the presented orientation; trials were scored as incorrect when the orientation error was greater than 30°. As shown in Supplementary Fig. 5, this approach to scoring yielded a classic blink effect, suggesting the task captures the important behavioural features of the widely reported AB phenomenon. For each lag condition, we found the proportion of responses (in 15° bins) between −90° and +90° for the orientation errors (see Figs. 2a and 4a) and fit Gaussian functions with a constant offset (Eq. 1) using non-linear least square regression to quantify these results for each participant (Figs. 2b and 4b):

$$G(x) = A\;{\mathrm{exp}}\left( { - \frac{{(x - \mu )^2}}{{2\sigma ^2}}} \right) + C,$$
(1)

where A is the gain, reflecting the proportion of responses around the reported orientation, μ is the orientation on which the function is centred (in degrees), σ is the standard deviation (degrees), which provides an index of the precision of participants’ responses, and C is a constant used to account for changes in the guessing rate. Using different bin sizes yields the same pattern of results suggesting this procedure did not bias the results (Supplementary Fig. 3). We used a Gaussian with a constant offset to characterise behavioural performance, as it captures the distribution of errors well (median R2 = 0.76, SE = 0.04 in Experiment 1). This model allows the gain, width, bias and guessing rates to vary independently (Supplementary Fig. 1), unlike the function used in a previous study using a continuous report measure for the AB30. Most importantly, the function we implemented can also be used to characterise the forward encoding results, thus allowing a direct comparison of the AB based upon behavioural and neural measures.

We used a regression-based approach63 (see Figs. 2d and 4c) to determine how targets and distractors within each RSVP stream influenced behavioural responses. To do this, we aligned the orientations of both distractor and target items from 4 items prior to the appearance of the target through to 9 items after the appearance of the target to construct a regression matrix of the presented orientations. The regression matrix was converted to complex numbers (to account for circularity of orientations) using Eq. 2:

$$C_1 = \exp (1i\;C),$$
(2)

where C is the regression matrix (in radians) and 1i is an imaginary unit. Standard linear regression was used to determine how the orientations of the items affected the reported orientation using Eq. 3:

$$W = \left( {C_1\;C_1^T} \right)^{ - 1}C_1^TR,$$
(3)

where R is the reported orientation (in radians). This was done separately for T1 and T2 reports, with a higher regression weight indicating the item was more influential in determining the reported orientation.

To determine whether the finding that the orientations of T1 and T2 influenced the reported orientation was due to participants integrating the other target or the surrounding distractors (Fig. 3), we found the difference in orientation between the target of interest and the other item (either target or distractor) and the orientation error for each trial. This showed an orientation-tuned effect characteristic of integration. To quantitatively determine the magnitude of this effect, we fit first-derivative Gaussian functions (D1; Eq. 4) to these responses36,37,38:

$${\mathrm{D}}1(x) = A \times \frac{1}{\sigma } \times x - \mu \times {\rm{exp}}\left( { - \frac{{x - \mu ^2}}{{2\sigma ^2}}} \right),$$
(4)

where A is the gain, μ is the orientation on which the function is centred (in degrees) and σ is the standard deviation (degrees).

### Forward encoding modelling

Forward encoding modelling was used to recover orientation-selective responses from the pattern of EEG activity for both target and distractor items in the RSVP stream. This technique has been used previously to reconstruct colour16, spatial15 and orientation19 selectivity from timeseries data acquired through fMRI. More recently, the same approach has been used to encode orientation9,12,13 and spatial14 information contained within MEG and EEG data, which have better temporal resolution than fMRI.

We used the orientations of the epoched data segments to construct a regression matrix with 9 regression coefficients, one for each of the orientations (Fig. 9a). This regression matrix was convolved with a tuned set of nine basis functions (half cosine functions raised to the eighth power9,10,13, Eq. 5) centred from 0° to 160° in 20° steps.

$$F\left( x \right) = \cos (x - \mu )^8,$$
(5)

where μ is the orientation on which the channel is centred, and x are orientations from 0º to 180º in 1º steps.

This tuned regression matrix was used to measure orientation information either across trials or in epoched segments. This was done by solving the linear Eq. (6):

$$B_1 = WC_1,$$
(6)

where B1 (64 sensors × N training trials) is the electrode data for the training set, C1 (9 channels × N training trials) is the tuned channel response across the training trials and W is the weight matrix for the sensors to be estimated (64 sensors × 9 channels). Following methods recently introduced for M/EEG analysis, we separately estimated the weights associated with each channel individually13,64. W was estimated using least square regression to solve Eq. (7):

$$W = \left( {C_1\;C_1^T} \right)^{ - 1}C_1^TB_1.$$
(7)

Following this previous work11,13,64, we removed the correlations between sensors, as these add noise to the linear equation. To do this, we first estimated the noise correlation between electrodes and removed this component through regularisation65,66 by dividing the weights by the shrinkage matrix. The channel response in the test set C2 (9 channels × N test trials) was estimated using the weights in (7) and applied to activity in B2 (64 sensors × N test trials), as per Eq. 8:

$$C_2 = \left( {W\;W^T} \right)W^TB_2.$$
(8)

To avoid overfitting, we used cross validation (10-fold in the initial whole-trial analysis, and 20-fold when the item presentations were stacked), where X-1 of epochs were used to train the model, and this was then tested on the remaining (X) epoch. This process was repeated until all epochs had served as both test and training trials. We also repeated this procedure for each point in the epoch to determine time-resolved feature-selectivity. To re-align the trials with the exact presented orientation, we reconstructed the item representation15 by multiplying the channel weights (9 channels × time × trial) against the basis set (180 orientations × 9 channels). This resulted in a 180 (−89° to 90°) Orientations × Trial × Time reconstruction. In order to average across trials, the orientation dimension was shifted so that 0º corresponded to the presented orientation in each trial.

For the initial encoding analysis (Fig. 5), to determine whether feature selectivity could be recovered for each RSVP item we used 20 encoding models (one for each item position in the stream) with 600 trials. We trained and tested each model across the entire 2250 ms of the trial to determine when feature selectivity emerged for that RSVP item. This analysis verified that each RSVP item could be encoded independently. We aligned all RSVP items across trials (N = 12,000; 600 trials by 20 items) and used a fixed encoding model for training and testing67,68 (Figs. 68). This meant we trained and tested all encoding models across all items (both targets and distractors) regardless of trial type12,13.

Aligned item reconstructions were then averaged over the relevant condition (Lag, Accuracy or item position) and smoothed using a Gaussian with a temporal kernel of 6 ms10,13 to quantify feature selectivity. The Gaussian functions were fit, using least square regression, to quantify different parameters of feature selectivity across timepoints, as per Eq. 1, where A is the gain representing the amount of feature selective activity, μ is the orientation on which the function is centred (in degrees), σ is the width (degrees) and C is a constant used to account for non-feature selective baseline shifts.

### Univariate orientation selectivity analysis

We used a univariate selectivity analysis10 to determine the topography associated with orientation-selective activity for targets and distractors (Fig. 8b). Data were epoched in the same manner as in the forward encoding model where EEG activity was aligned with each stream item. We separated these epochs into target and distractor presentations to determine whether these two types of stimulus were processed differently. All target presentations were used in training (1200 in total; 600 trials with two targets in each), together with a pseudo-random selection of the same number of distractor items. To determine the topography, we used a general linear model to estimate orientation selectivity for each sensor from the sine and cosine of the presentation orientation, and a constant regressor in each presentation. From the weights of the two orientation coefficients we calculated selectivity using Eq. 9:

$$A = \sqrt {B_1{\mathrm{cos}}^2 + B_2{\mathrm{sin}}^2},$$
(9)

A was derived through permutation testing in which the design matrix was shuffled (N = 1000) and weights calculated. The non-permuted weights were ranked and compared with the permutation distribution, thus enabling calculation of the z-scored difference. To calculate group-level effects, cluster-based sign-flipping permutation testing (N = 1500) across electrodes and time was implemented in Fieldtrip69 to determine whether the topographies differed between conditions.

### Statistics

All statistical tests were two-sided, and Bonferroni adjustments were used to correct for multiple comparisons where noted. Non-parametric sign permutation tests69,70 were used to determine differences in the time courses of feature selectivity (Figs. 5 and 6) between conditions. The sign of the data was randomly flipped (N = 20,000), with equal probability, to create a null distribution. Cluster-based permutation testing was used to correct for multiple comparisons over the timeseries, with a cluster-form threshold of p < 0.05 and significance threshold of p < 0.05.

### Reporting summary

Further information on research design is available in the Nature Research Reporting Summary linked to this article.

## Code availability

The code associated with this paper is available at: https://github.com/MatthewFTang/AttentionalBlinkForwardEncoding.

## References

1. McLeod, P. Parallel processing and the psychological refractory period. Acta Psychologica 41, 381–396 (1977).

2. Welford, A. T. The ‘psychological refractory period’ and the timing of high-speed performance—a review and a theory. Br. J. Psychol. Gen. Sect. 43, 2–19 (1952).

3. Shapiro, K. L., Arnell, K. M. & Raymond, J. E. The attentional blink. Trends Cogn. Sci. 1, 291–296 (1997).

4. Raymond, J. E., Shapiro, K. L. & Arnell, K. M. Temporary suppression of visual processing in an RSVP task: an attentional blink? J. Exp. Psychol.: Hum. Percept. Perform. 18, 849–860 (1992).

5. Broadbent, D. E. & Broadbent, M. H. P. From detection to identification: response to multiple targets in rapid serial visual presentation. Percept. Psychophys. 42, 105–113 (1987).

6. Williams, M. A., Visser, T. A. W., Cunnington, R. & Mattingley, J. B. Attenuation of neural responses in primary visual cortex during the attentional blink. J. Neurosci. 28, 9890–9894 (2008).

7. Marois, R., Yi, D.-J. & Chun, M. M. The neural fate of consciously perceived and missed events in the attentional blink. Neuron 41, 465–472 (2004).

8. Vogel, E. K., Luck, S. J. & Shapiro, K. L. Electrophysiological evidence for a postperceptual locus of suppression during the attentional blink. J. Exp. Psychol.: Hum. Percept. Perform. 24, 1656–1674 (1998).

9. Garcia, J. O., Srinivasan, R. & Serences, J. T. Near-real-time feature-selective modulations in human cortex. Curr. Biol. 23, 515–522 (2013).

10. Myers, N. E. et al. Testing sensory evidence against mnemonic templates. eLife 4, e09000 (2015).

11. Wolff, M. J., Jochim, J., Akyürek, E. G. & Stokes, M. G. Dynamic hidden states underlying working-memory-guided behavior. Nat. Neurosci. 20, 864–871 (2017).

12. Tang, M. F., Smout, C. A., Arabzadeh, E. & Mattingley, J. B. Prediction error and repetition suppression have distinct effects on neural representations of visual information. eLife 7, e33123 (2018).

13. Smout, C. A., Tang, M. F., Garrido, M. I. & Mattingley, J. B. Attention promotes the neural encoding of prediction errors. PLoS Biol. 17, e2006812 (2019).

14. Foster, J. J., Sutterer, D. W., Serences, J. T., Vogel, E. K. & Awh, E. The topography of alpha-band activity tracks the content of spatial working memory. J. Neurophysiol. 115, 168–177 (2016).

15. Sprague, T. C. & Serences, J. T. Attention modulates spatial priority maps in the human occipital, parietal and frontal cortices. Nat. Neurosci. 16, 1879–1887 (2013).

16. Brouwer, G. J. & Heeger, D. J. Decoding and reconstructing color from responses in human visual cortex. J. Neurosci. 29, 13992–14003 (2009).

17. McAdams, C. J. & Maunsell, J. H. R. Effects of attention on orientation-tuning functions of single neurons in macaque cortical area V4. J. Neurosci. 19, 431–441 (1999).

18. Maunsell, J. H. R. Neuronal mechanisms of visual attention. Annu. Rev. Vis. Sci. 1, 373–391 (2015).

19. Ester, E. F., Sutterer, D. W., Serences, J. T. & Awh, E. Feature-selective attentional modulations in human frontoparietal cortex. J. Neurosci. 36, 8188–8199 (2016).

20. Treue, S. & Martinez Trujillo, J. C. Feature-based attention influences motion processing gain in macaque visual cortex. Nature 399, 575–579 (1999).

21. Maunsell, J. H. R. & Treue, S. Feature-based attention in visual cortex. Trends Neurosci. 29, 317–322 (2006).

22. Maloney, R. T., Jayakumar, J., Levichkina, E. V., Pigarev, I. N. & Vidyasagar, T. R. Information processing bottlenecks in macaque posterior parietal cortex: an attentional blink? Exp. Brain Res. 228, 365–376 (2013).

23. Raymond, J. E., Shapiro, K. L. & Arnell, K. M. Similarity determines the attentional blink. J. Exp. Psychol.: Hum. Percept. Perform. 21, 653–662 (1995).

24. Lagroix, H. E. P., Spalek, T. M., Wyble, B., Jannati, A. & Di Lollo, V. The root cause of the attentional blink: First-target processing or disruption of input control? Atten., Percept., Psychophys. 74, 1606–1622 (2012).

25. Chun, M. M. & Potter, M. C. A two-stage model for multiple target detection in rapid serial visual presentation. J. Exp. Psychol.: Hum. Percept. Perform. 21, 109–127 (1995).

26. Duncan, J., Ward, R. & Shapiro, K. Direct measurement of attentional dwell time in human vision. Nature 369, 313–315 (1994).

27. Di Lollo, V., Kawahara, J. I., Shahab Ghorashi, S. M. & Enns, J. T. The attentional blink: Resource depletion or temporary loss of control? Psychological Res. 69, 191–200 (2005).

28. Akyürek, E. G. et al. Temporal target integration underlies performance at lag 1 in the attentional blink. J. Exp. Psychol.: Hum. Percept. Perform. 38, 1448–1464 (2012).

29. Akyürek, E. G. & Hommel, B. Target integration and the attentional blink. Acta Psychologica 119, 305–314 (2005).

30. Asplund, C. L., Fougnie, D., Zughni, S., Martin, J. W. & Marois, R. The attentional blink reveals the probabilistic nature of discrete conscious perception. Psychological Sci. 25, 824–831 (2014).

31. Dehaene, S. & Naccache, L. Towards a cognitive neuroscience of consciousness: basic evidence and a workspace framework. Cognition 79, 1–37 (2001).

32. Nieuwenhuis, S. & de Kleijn, R. Consciousness of targets during the attentional blink: a gradual or all-or-none dimension? Atten., Percept., Psychophys. 73, 364–373 (2011).

33. Visser, T. A. W. Expectancy-based modulations of lag-1 sparing and extended sparing during the attentional blink. J. Exp. Psychol.: Human Percept. Perform. 41, 462–478 (2015).

34. Fischer, J. & Whitney, D. Serial dependence in visual perception. Nat. Neurosci. 17, 738–743 (2014).

35. Alais, D., Leung, J. & Van der Burg, E. Linear summation of repulsive and attractive serial dependencies: orientation and motion dependencies sum in motion perception. J. Neurosci. 37, 4381–4390 (2017).

36. Dickinson, J. E., Almeida, R. A., Bell, J. & Badcock, D. R. Global shape aftereffects have a local substrate: a tilt aftereffect field. J. Vision10, 1–12 (2010).

37. Dickinson, J. E., Morgan, S. K., Tang, M. F. & Badcock, D. R. Separate banks of information channels encode size and aspect ratio. J. Vision 17, 27 (2017).

38. Tang, M. F., Dickinson, J. E., Visser, T. A. W. & Badcock, D. R. The broad orientation dependence of the motion streak aftereffect reveals interactions between form and motion neurons. J. Vision 15, 4 (2015).

39. Visser, T. A. W., Bischof, W. F. & Di Lollo, V. Rapid serial visual distraction: task-irrelevant items can produce an attentional blink. Percept. Psychophys. 66, 1418–1432 (2004).

40. Visser, T. A. W., Tang, M. F., Badcock, D. R. & Enns, J. T. Temporal cues and the attentional blink: a further examination of the role of expectancy in sequential object perception. Atten. Percept. Psychophys. 76, 2212–2220 (2014).

41. Visser, T. A. W. T1 difficulty and the attentional blink: Expectancy versus backward masking. Q. J. Exp. Psychol. 60, 936–951 (2007).

42. Brehaut, J. C., Enns, J. T. & Di Lollo, V. Visual masking plays two roles in the attentional blink. Percept. Psychophys. 61, 1436–1448 (1999).

43. Wyble, B., Bowman, H. & Nieuwenstein, M. The attentional blink provides episodic distinctiveness: Sparing at a cost. J. Exp. Psychol.: Hum. Percept. Perform. 35, 787–807 (2009).

44. Rees, G. G., Friston, K. K. & Koch, C. C. A direct quantitative relationship between the functional properties of human and macaque V5. Nat. Neurosci. 3, 716–723 (2000).

45. Shapiro, K., Driver, J., Ward, R. & Sorensen, R. E. Priming from the attentional blink: a failure to extract visual tokens but not visual types. Psychological Sci. 8, 95–100 (1997).

46. Bays, P. M., Catalao, R. F. G. & Husain, M. The precision of visual working memory is set by allocation of a shared resource. J. Vision 9, 7 (2009).

47. Johnston, J. C., Hochhaus, L. & Ruthruff, E. Repetition blindness has a perceptual locus: evidence from online processing of targets in RSVP streams. J. Exp. Psychol.: Hum. Percept. Perform. 28, 477–489 (2002).

48. Folk, C. L., Remington, R. W. & Johnston, J. C. Involuntary covert orienting is contingent on attentional control settings. J. Exp. Psychol.: Hum. Percept. Perform. 18, 1030 (1992).

49. Hanslmayr, S., Gross, J., Klimesch, W. & Shapiro, K. L. The role of alpha oscillations in temporal attention. Brain Res. Rev. 67, 331–343 (2011).

50. Pelli, D. G. The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat. Vis. 10, 437–442 (1997).

51. Brainard, D. H. The psychophysics toolbox. Spat. Vis. 10, 433–436 (1997).

52. Kanwisher, N. G. Repetition blindness: type recognition without token individuation. Cognition 27, 117–143 (1987).

53. Tang, M. F., Badcock, D. R. & Visser, T. A. W. Training and the attentional blink: limits overcome or expectations raised? Psychonomic Bull. Rev. 21, 406–411 (2014).

54. Willems, C., Herdzin, J. & Martens, S. Individual differences in temporal selective attention as reflected in pupil dilation. PLoS ONE 10, e0145056–13 (2015).

55. Harris, J. A., McMahon, A. R. & Woldorff, M. G. Disruption of visual awareness during the attentional blink is reflected by selective disruption of late-stage neural processing. J. Cogn. Neurosci. 25, 1863–1874 (2013).

56. Zauner, A. et al. Alpha entrainment is responsible for the attentional blink phenomenon. NeuroImage 63, 674–686 (2012).

57. Wierda, S. M., van Rijn, H., Taatgen, N. A. & Martens, S. Distracting the mind improves performance: an ERP study. PLoS ONE 5, e15024 (2010).

58. Oostenveld, R. & Praamstra, P. The five percent electrode system for high-resolution EEG and ERP measurements. Clin. Neurophysiol. 112, 713–719 (2001).

59. Delorme, A. & Makeig, S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21 (2004).

60. Keil, A. et al. Committee report: publication guidelines and recommendations for studies using electroencephalography and magnetoencephalography. Psychophysiology 51, 1–21 (2014).

61. Bigdely-Shamlo, N., Mullen, T., Kothe, C., Su, K.-M. & Robbins, K. A. The PREP pipeline: standardized preprocessing for large-scale EEG analysis. Front. Neuroinformatics 9, B153 (2015).

62. Chaumon, M., Bishop, D. V. M. & Busch, N. A. A practical guide to the selection of independent components of the electroencephalogram for artifact correction. J. Neurosci. Methods 250, 47–63 (2015).

63. Cheadle, S. et al. Adaptive gain control during human perceptual choice. Neuron 81, 1429–1441 (2014).

64. Kok, P., Mostert, P. & De Lange, F. P. Prior expectations induce prestimulus sensory templates. Proc. Natl Acad. Sci. USA 114, 10473–10478 (2017).

65. Blankertz, B., Lemm, S., Treder, M., Haufe, S. & Müller, K.-R. Single-trial analysis and classification of ERP components—a tutorial. NeuroImage 56, 814–825 (2011).

66. Ledoit, O. & Wolf, M. A well-conditioned estimator for large-dimensional covariance matrices. J. Multivar. Anal. 88, 365–411 (2004).

67. Sprague, T. C., Boynton, G. M. & Serences, J. T. Inverted encoding models estimate sensible channel responses for sensible models. bioRxiv 91, 642710 (2019).

68. Sprague, T. C. et al. Inverted encoding models assay population-level stimulus representations, not single-unit neural tuning. eNeuro 5, ENEURO.0098–18.2018 (2018).

69. Oostenveld, R., Martin, Maris, E. & Schoffelen, J.-M. FieldTrip: open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data. Comput. Intell. Neurosci. 2011, 1–9 (2010).

70. Maris, E. & Oostenveld, R. Nonparametric statistical testing of EEG- and MEG-data. J. Neurosci. Methods 164, 177–190 (2007).

## Acknowledgements

The authors would like to thank Brad Wyble for comments on a pre-print of this manuscript. This work was supported by the Australian Research Council (ARC) Centre of Excellence for Integrative Brain Function (CE140100007). MFT was supported by the NVIDIA corporation who donated a TITAN V GPU. EA was supported by an ARC Discovery Project (DP170100908). JTE was supported by a Discovery Grant from the Natural Sciences and Engineering Research Council (Canada). TAWV was supported by an ARC Discovery Project (DP120102313). JBM was supported by an ARC Australian Laureate Fellowship (FL110100103), an ARC Discovery Project (DP140100266), and by the Canadian Institute for Advanced Research (CIFAR).

## Author information

Authors

### Contributions

M.F.T.—conception, data gathering, data analysis, original draft, final approval. L.F.—data gathering, draft editing, final approval. E.A.—draft editing, final approval. J.T.E.—draft editing, final approval. T.A.W.V.—conception, draft editing, final approval. J.B.M.—conception, draft editing, final approval.

### Corresponding author

Correspondence to Matthew F. Tang.

## Ethics declarations

### Competing interests

The authors declare no competing interests.

Peer review information Nature Communications thanks Edward Ester and the other, anonymous, reviewer(s) for their contribution to the peer review of this work. Peer reviewer reports are available.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## Rights and permissions

Reprints and Permissions

Tang, M.F., Ford, L., Arabzadeh, E. et al. Neural dynamics of the attentional blink revealed by encoding orientation selectivity during rapid visual presentation. Nat Commun 11, 434 (2020). https://doi.org/10.1038/s41467-019-14107-z

• Accepted:

• Published:

• DOI: https://doi.org/10.1038/s41467-019-14107-z