This study aimed to investigate the time course of attentional bias for negative information in healthy individuals and to assess the associated influence of trait anxiety. Thirty-eight healthy volunteers performed an emotional dot-probe task with pairs of negative and neutral scenes, presented for either 1 or 2 s and followed by a target placed at the previous location of either negative or neutral stimulus. Analyses included eye movements during the presentation of the scenes and response times associated with target localization. In a second step, analyses focused on the influence of trait anxiety. While there was no significant difference at the behavioral level, the eye-tracking data revealed that negative information held longer attention than neutral stimuli once fixated. This initial maintenance bias towards negative pictures then increased with increasing trait anxiety. However, at later processing stages, only individuals with the highest trait anxiety appeared to fixate longer on negative pictures than neutral pictures, individuals with low trait anxiety showing the opposite pattern. This study provides novel evidence that healthy individuals display an attentional maintenance bias towards negative stimuli, which is associated with trait anxiety.
Vision, like the other sensory systems, is constrained by its limited capacity of processing. Attention allows coping with this issue by selecting specific information within our rich and complex environment that will benefit from more elaborate processing and access to consciousness. The properties of the retina also constrain visual perception by limiting high-resolution processing to the fovea, which covers only the central 2° of visual angle. In naturalistic viewing, attentional selection relies on eye movements allowing to bring visual stimuli onto the fovea1. Overt attention is functionally coupled to, and share neural mechanisms with2,3,4, covert attention that improves perception at a specific visual location without gaze reorienting but also guides eye movements5,6,7,8,9,10. Attentional selection is also supposed to operate according to two complementary and interacting processes11,12,13,14. The reflexive or exogenous attention is a fast, bottom-up (stimulus-driven) process that selects stimuli according to their physical features or because they are novel or unexpected. The voluntary or endogenous attention is a slower, top-down (goal-driven) process selecting stimuli that are expected or relevant to current goals. It is also increasingly recognized that emotionally laden stimuli, given their strong adaptive significance, benefit from preferential processing over neutral stimuli15,16. The exact nature of the mechanisms responsible for this effect remains open to debate, in particular regarding the degree to which they differ from classical attention mechanisms17,18. However, evidence suggests that "emotional attention" also involves a balance between bottom-up and top-down processes17,19. The valence-related salience of a stimulus may thus depend on internal factors20, and there has been much interest regarding the link between anxiety and the special status of negative information21,22.
Cognitive models of anxiety posit that, even though effective detection of danger is crucial for survival, interindividual differences exist regarding the processing of threatening information23,24,25,26,27. Trait anxiety, which constitutes a vulnerability to affective disorders28,29, is supposed to be associated with a preferential selection of aversive stimuli over neutral cues so that individuals with high trait anxiety, unlike those with low trait anxiety, would present with attentional bias (AB) to threat19,30, 31. One of the most commonly used paradigms to assess AB for emotional information is the emotional dot-probe task32. In this task, two visual stimuli (one emotional stimulus and one neutral stimulus; either words, photographs of facial expressions, or pictures of natural scenes) are displayed simultaneously on the left and right side of a computer screen. AB towards or away from emotional stimuli is respectively inferred by faster or slower responses to detect a probe replacing an emotional stimulus than a probe replacing a neutral stimulus. The meta-analysis on threat-related AB performed by Bar-Haim et al.30, which included numerous dot-probe studies, found that individuals suffering from an anxiety disorder or with high trait anxiety, but not non-anxious persons, show an AB towards threat-related stimuli of comparable magnitude.
Two main hypotheses attempt to account for the influence of anxiety on visual attentional processing33. On the one hand, the "vigilance-avoidance" hypothesis26 suggests that anxiety is associated with facilitated orienting of attention towards threat-related stimuli. These vigilance responses, based on a reflexive selection of negative stimuli, are thought to be followed by a more strategic avoidance of this information. On the other hand, the "maintenance" hypothesis34 posits that threat-related stimuli, once they are detected, hold attention longer than neutral stimuli in anxious individuals. This attentional maintenance bias could be due to a general difficulty associated with trait anxiety in recruiting top-down control systems in situations involving competing stimuli and when task demands do not fully occupy attentional resources19,24,35,36. Several studies used emotional dot-probe task with different stimuli durations to investigate the time course of attentional allocation. The underlying rationale is that using different stimuli durations allows distinguishing between initial vigilance (short exposure duration) and later maintenance of attention (long exposure duration)37,38,39,40. The meta-analysis by Bar-Haim et al.30 found that anxious participants showed an AB towards negative information for all the tested exposure times (subliminal, 500 ms, or ≥ 1,000 ms), but differences with healthy controls were not significant for longer stimuli durations. Studies specifically designed to assess the time-course of AB for threatening stimuli with different exposure durations led to mixed results: while the study by Mogg et al.38 found no effect of exposure duration, others evidenced increased vigilance in individuals with high trait anxiety only for a short exposure duration (500 ms)37,39,40, sometimes followed by avoidance with increasing exposure time40. It appears, therefore, that AB for aversive stimuli operates at an early attentional stage, whereas evidence is less clear regarding the maintenance of attention.
Furthermore, there are many concerns expressed regarding the link between anxiety and disproportionate attention to aversive stimuli, and on the efficiency of AB assessment methods41,42. If some authors proposed that contradictory results obtained by dot-probe studies are due to methodological heterogeneity (e.g., the types of stimuli used or of anxiety investigated43), a recent meta-analysis did not found any evidence for AB towards threat in individuals with clinical anxiety (n = 1,005)44. This meta-analysis used another source of dot-probe data that emerged after the meta-analysis of Bar-Haim et al.30, namely baseline measures of AB obtained in randomized controlled trials evaluating the clinical efficacy of attentional bias modification procedures as a treatment for post-traumatic stress disorder (PTSD), social anxiety or panic disorder. It was thus not possible for the authors to test whether healthy individuals display an AB. Moreover, all the 13 studies included in this meta-analysis used a stimulus duration of 500 ms, leaving untested the possibility for AB to emerge after more prolonged exposure to stimuli. Finally, and importantly, one limitation of behavioral measures such as response time (RT) is that they only inform on the final processing output. In the context of dot-probe tasks, RT-based measures inform on attention at a single time point only, after stimuli replacement by the probe stimulus45,46 and, therefore, do not directly assess information processing during actual exposure to stimuli.
The eye-tracking technology automatically detects eye position and gaze direction with a high temporal resolution and is thus an interesting method to investigate the time course of attentional deployment. Eye movements are faster and considered as a more direct manifestation of attention than manual responses, so that they may be more adapted to the study of emotional attention18,47. Although eye-tracking studies on this topic are limited18, a series of studies using free viewing tasks found that healthy volunteers were more likely to fixate first on negative scenes presented concurrently with neutral scenes46,48,49,50,51. However, Quigley et al.46 observed this initial orienting bias towards negative stimuli regardless of trait anxiety, and Calvo and Avero52 only in individuals with high trait anxiety. Studies analyzing attentional maintenance also found mixed findings. Some authors reported that healthy volunteers showed a higher viewing time on negative pictures than on neutral pictures at the beginning of exposure48, regardless of trait anxiety46. Conversely, the study by Calvo and Avero52 revealed that only individuals with high trait anxiety showed higher gaze duration for pictures depicting actual harm than neutral pictures, followed by the opposite effect at later processing stages.
Given these controversial results, the present study used the eye-tracking technology to clarify (1) the time course of attentional capture by negative stimuli in healthy volunteers and (2) the associated influence of trait anxiety. To ensure comparability with previous behavioral studies investigating AB for negative stimuli, we used an emotional dot-probe task. Thirty-eight individuals took part in this study in which pairs of negative and neutral scenes selected from the International Affective Picture System53 (IAPS) were presented for either 1,000 or 2,000 ms and followed by a target placed at the previous location of either negative (i.e., congruent condition) or neutral stimulus (i.e., incongruent condition). The two exposure durations allowed to assess the dynamics of information processing with both analyses of eye movements during actual exposure to stimuli and standard AB measures calculated from RTs associated with correct probe detection. Regarding eye movements, analyses of first fixation direction and latency allowed to investigate the initial orientation of attention, whereas analyses of dwell time and the total count of fixations served as indexes of the overall maintenance of attention. We also examined the first fixation duration as an index of initial maintenance of attention, and the average duration of fixations as an index of re-engagement of attention. In a second step of the analyses, we investigated the links between trait anxiety, assessed with the trait part of the State-Trait Anxiety Inventory (STAI, Form Y)54, and eye-tracking measures, as well as RT-based measures. The influence of cognitive control is likely to increase as the visual information is processed, so trait anxiety effects would concern mostly maintenance of attention, and could be stronger with increasing exposure time19,24,35,36.
Characteristics of the stimuli
The stimuli were pictures selected from the IAPS according to gender. Each gender-based set included 24 negative and 24 neutral pictures (see Table S1 in Supplemental Information). Regarding emotional characteristics, valence was significantly lower for negative pictures than for neutral pictures, and arousal was significantly higher for negative pictures than for neutral pictures (all p values < 0.05). Regarding visual characteristics, negative and neutral pictures did not differ in terms of luminance, color saturation (RGB), and energy across spatial frequencies (all p values > 0.05). Finally, regarding cognitive characteristics, negative and neutral pictures did not differ in terms of complexity (JPEG file size), and face area (the percentage of the area occupied by faces in each picture; all p values > 0.05).
Among the 38 participants, the mean STAI score for trait anxiety was 41 ± 9 (range = 26–58). According to the French norms54, twelve participants had very low trait anxiety (T-note ≤ 35), 13 had low trait anxiety (T-note between 36 and 45), 12 had medium trait anxiety (T-note between 46 and 55), 1 had high trait anxiety (T-note between 56 and 65), and none had very high trait anxiety (T-note > 65).
The threshold of significance was set at p < 0.008 (see “Eye gaze data” section).
First fixation direction
On average, the first fixation occurred on one of the two pictures in 80 ± 16% of the trials. The probability of first fixating the negative pictures (M = 40.68%, SE = 1.47) did not significantly differ from 50%, t(37) = 0.83, p = 0.410, d = 0.14, suggesting that there was no significant orienting bias towards or away from negative stimuli. The probability of first fixating the negative pictures was not significantly correlated with trait anxiety, r = −0.19, p = 0.255.
First fixation latency
The first fixation latency did not significantly differ between the neutral pictures (Mdn = 238 ms) and the negative pictures (Mdn = 261 ms), V = 502, p = 0.057, r = −0.31. The difference between first fixation latencies for negative and neutral pictures was not significantly correlated with trait anxiety, r = 0.11, p = 0.525.
First fixation duration
The first fixations were significantly longer for the negative images (Mdn = 233 ms) than for the neutral images (Mdn = 206 ms), V = 589, p = 0.001, r = −0.53. The difference between first fixation durations for negative and neutral pictures was not significantly correlated with trait anxiety, rs = 0.17, p = 0.301.
The means and standard errors of dwell time are shown in Table 1. There was a significant main effect of exposure duration, F(1,37) = 363.32, p < 0.001, η2p = 0.91, showing longer dwell time in the 2,000 ms condition (M = 533 ms, SE = 24) than in the 1,000 ms condition (M = 240 ms, SE = 10). The main effect of valence was also significant, F(1,37) = 34.36, p < 0.001, η2p = 0.48, indicating longer dwell time on negative pictures (M = 417 ms, SE = 19) than on neutral pictures (M = 357, SE = 17). The interaction between exposure duration and valence was not significant, F(1,37) = 0.04, p = 0.852, η2p < 0.01.
The addition of trait anxiety as a continuous predictor in the analysis of variance revealed that the main effect of trait anxiety, F(1,36) = 4.097, p = 0.051, η2p = 0.10, the interaction between trait anxiety and exposure duration, F(1,36) = 4.92, p = 0.033, η2p = 0.12, and the interaction between trait anxiety, exposure duration and valence, F(1,36) = 0.93, p = 0.342, η2p = 0.03, were not significant. However, there was a significant interaction between trait anxiety and valence, F(1,36) = 8.31, p = 0.007, η2p = 0.19 (Fig. 1A). Further analysis of the association between trait anxiety and valence revealed that the bias in dwell time towards negative pictures increased with increasing trait anxiety (see Supplementary Information, 1.1, for details).
Total fixation count
The means and standard errors of the total fixation counts are shown in Table 2. There was a significant main effect of exposure duration, F(1,37) = 264.24, p < 0.001, η2p = 0.88, showing more fixations in the 2,000 ms condition (M = 2.347, SE = 0.102) than in the 1,000 ms condition (M = 1.283, SE = 0.048). The main effect of valence was also significant, F(1,37) = 41.27, p < 0.001, η2p = 0.53, indicating more fixations on negative pictures (M = 1.971, SE = 0.084) than on neutral pictures (M = 1.660, SE = 0.068). The interaction between exposure duration and valence was not significant, F(1,37) = 3.49, p = 0.070, η2p = 0.09.
The addition of trait anxiety as a continuous predictor in the analysis of variance revealed that the main effect of trait anxiety, F(1,36) = 4.17, p = 0.048, η2p = 0.10, the interaction between trait anxiety and exposure duration, F(1,36) = 7.60, p = 0.009, η2p = 0.17, the interaction between trait anxiety and valence, F(1,36) = 4.29, p = 0.046, η2p = 0.11, and the interaction between trait anxiety, exposure duration and valence, F(1,36) = 0.00, p = 0.998, η2p < 0.01, were not significant.
Average fixation duration
The means and standard errors of the average fixation duration are shown in Table 3. The main effect of valence was not significant, F(1,37) = 0.14, p = 0.714, η2p < 0.01. The main effect of exposure duration was significant, F(1,37) = 66.65, p < 0.001, η2p = 0.64, showing that average fixation duration was longer in the 2,000 ms condition (M = 249 ms, SE = 9) than in the 1,000 ms condition (M = 194 ms, SE = 5). The interaction between exposure duration and valence was not significant, F(1,37) = 5.66, p = 0.023, η2p = 0.13.
The addition of trait anxiety as a continuous predictor in the analysis of variance did not reveal any significant main effect of trait anxiety, F(1,36) = 0.42, p = 0.522, η2p = 0.01. The interaction between trait anxiety and exposure duration, F(1,36) = 0.29, p = 0.591, η2p < 0.01, and the interaction between trait anxiety and valence, F(1,36) = 4.67, p = 0.037, η2p = 0.11, were not significant. There was a significant interaction between trait anxiety, exposure duration and valence, F(1,36) = 10.61, p = 0.002, η2p = 0.23. The difference in average fixation duration between negative pictures and neutral pictures was significantly correlated with trait anxiety in the 2,000 ms condition (r = 0.51, p = 0.001; Fig. 1 B) but not in the 1,000 ms condition (r = −0.13, p = 0.422). Further analysis of this significant association in the 2,000 ms condition revealed that, while average fixation duration was shorter for negative pictures than for neutral pictures among individuals showing the lowest trait anxiety scores, this bias was reversed and not significant among individuals showing the highest trait anxiety scores (see Supplementary Information, 1.1, for details).
The threshold of significance was set at p < 0.05. AB scores (i.e. the difference of mean RT between congruent and incongruent trials) were not significantly different from 0 in the 1,000 ms condition (M = −2 ms, SE = 4), t(37) = −0.38, p = 0.703, d = −0.06, and in the 2,000 ms condition (M = −1 ms, SE = 4), t(37) = −0.33, p = 0.745, d = −0.05. There was no significant main effect of exposure duration, F(1,37) = 0.00, p = 0.974, η2p < 0.01. The addition of trait anxiety as a continuous predictor in the analysis of variance did not reveal any significant effect of trait anxiety, F(1,36) = 1.50, p = 0.228, η2p = 0.04, or significant interaction between trait anxiety and exposure duration, F(1,36) = 0.64, p = 0.430, η2p = 0.02.
The objective of this study was twofold, as it aimed to (1) investigate the time course of attentional capture by negative stimuli in healthy volunteers and (2) assess the associated influence of trait anxiety. To this end, we recorded eye movements and RTs of 38 healthy participants performing an emotional dot-probe task in which pairs of negative and neutral scenes were presented simultaneously for either 1,000 or 2,000 ms.
Previous results from eye-tracking studies in which participants viewed pairs of emotional and neutral scenes were controversial. Regarding initial orienting of attention, some studies showed more first fixations on negative pictures than neutral pictures46,48,49,50,51, regardless of trait anxiety46, or only in high trait anxious individuals52. Regarding attentional maintenance, some studies reported a higher viewing time on negative pictures than on neutral pictures at early processing stages in healthy volunteers48, regardless of trait anxiety46. Others found this effect only in individuals with high trait anxiety, which then avoided aversive stimuli52.
In our study, analyses of eye-tracking data did not reveal any significant difference between negative and neutral stimuli regarding first fixation direction and first fixation latency, even when considering trait anxiety. Nonetheless, we found both higher dwell time and more frequent fixations on negative pictures than on neutral pictures, regardless of stimuli duration. From these results, it appears that healthy volunteers presented, therefore, with an attentional maintenance bias towards aversive stimuli in the first 1,000 ms of exposure, and not in the last 1,000 ms of exposure. Moreover, the analysis of dwell time also revealed that the AB increased with increasing anxiety. Altogether, results are thus in favor of the attentional maintenance hypothesis34, which posits, unlike the vigilance-avoidance hypothesis26, that there is no facilitation of attentional orienting towards threat-related stimuli, which hold attention once detected33.
However, the results obtained for the first fixation duration and the average fixation duration refined the analysis of the dynamics of AB to negative pictures. The first fixation duration was longer on negative stimuli than on neutral stimuli, regardless of trait anxiety. Therefore, higher trait anxiety increased the dwell time bias towards negative pictures in the first 1,000 ms of exposure, but probably only after the first fixation on one of the two pictures. Moreover, regarding the average fixation duration, the difference between negative and neutral pictures correlated with trait anxiety only in the 2,000 ms condition. This significant association showed that, at later processing stages (i.e., during fixations in the last 1,000 ms of the 2,000 ms condition), neutral stimuli held attention longer in individuals with low trait anxiety. In contrast, negative pictures still tended to hold longer attention in more anxious individuals.
Interestingly, the model of Williams et al.27 posits that trait anxiety influences the allocation of attention after the assessment of the threat value of a stimulus. According to this model, individuals with high trait anxiety would be more likely to orient towards aversive stimuli, while individuals with low trait anxiety may present a tendency to shift their attention away from these stimuli. From our results, we can suggest that predictions of this model and that of the maintenance hypothesis are not incompatible and may reflect different attentional stages. Indeed, it appears that negative information holds longer attention than neutral stimuli once fixated. In line with the maintenance hypothesis, this initial maintenance bias increases with increasing trait anxiety, but only transiently. Then, in line with the model of Williams et al.27, only individuals with the highest trait anxiety longer fixate negative pictures than neutral pictures, whereas individuals with low trait anxiety present a maintenance bias away from aversive information.
Importantly, the interpretation in terms of attentional maintenance implies that higher dwell time and longer fixation duration reflect sustained attention, as classically hypothesized by eye-tracking studies on attention18,47. First, several bottom-up and top-down factors are likely to influence gaze fixation and duration55. For instance, some categories of visual stimuli can attract more fixations than others because of their visual saliency. In line with previous works48,49,50, we carefully controlled the physical parameters of images to minimize the possibility that these stimulus-driven factors influenced our results. Besides, longer dwell time or fixation duration can also reflect processing difficulty56. For this reason, we also considered pictures' complexity, in line with previous studies using pictures of natural scenes48,49,51, so that the only significant difference between the negative pictures and the neutral pictures concerned their affective dimensions.
Then, in eye-tracking research, the choice of the task is critical to draw valid conclusions as it determines inferences regarding the cognitive processes responsible for the eye movements57. On the one hand, in line with previous eye-tracking studies investigating attention to pairs of emotional and neutral images, we used a free viewing task with fixed stimuli duration46,48,49,50,51,52. Fixed exposure duration induces time pressure but can also create experiences of idleness that could significantly influence the interpretation of data55,58, in particular when participants have no instruction at all. One can assume that it is most likely more evident to link eye movements to the attentional allocation when free viewing tasks require a response as they encourage participants to be attentive59. The difference of paradigm may thus explain the discrepancies between the eye-tracking results obtained when participants had no specific instructions46 and results of studies requiring, like ours, a manual response by the participants48,49,50,51,52.
On the other hand, however, the relevance of the stimuli for the task is another critical factor to consider as it influences the interpretation of data55,60. Regarding eye-tracking research on attentional capture by emotional stimuli, tasks with instructions emphasizing the affective content of pictures imply looking at both pictures. In the previous studies mentioned earlier, participants had to discriminate valence of pictures48,51,52, or determine whether a subsequently presented picture had the same content as one of these two scenes49,50. Accordingly, the emotional content of the stimuli was relevant to the task and probably influenced the time course of information processing. In this context, it is thus challenging to determine whether valence-related differences in eye-tracking measures in either early or late processing stages reflected effects in initial orienting or maintenance of attention. For instance, the study by Calvo and Lang48 found that the emotional advantage was limited to early attentional maintenance. In their study, however, the lack of significant difference between emotional and neutral pictures at later processing stages was possibly due to the task as participants were required to determine whether the valence of the two concomitantly presented pictures differed or not. Thus, participants, after having oriented first their attention towards the emotional stimulus, probably looked at the neutral picture to perform the task accurately. In the study by Calvo and Avero52, the same task was employed and may have limited the possibility to investigate some anxiety effects at later time intervals36.
Contrary to those studies, we employed the dot-probe paradigm, which is classically used to assess selective attention32. Participants had to detect targets appearing (1) just after the natural scenes that were presented during an unpredictable duration of either 1,000 ms or 2,000 ms and (2) at an unpredictable location, either the one previously occupied by the negative stimulus or the one previously occupied by the neutral stimulus. Using this paradigm, we probably assessed more directly the influence of emotion on the spatio-temporal deployment of visual attention than studies with free viewing tasks without specific instruction or requiring valence discrimination, or a subsequent recognition test46,48,49,50,51,52. Furthermore, these different tasks probably involve different attentional mechanisms17,46, which could explain while we failed to find any evidence for a preferential initial orienting towards negative pictures, unlike those studies. Indeed, even though orienting towards emotional stimuli may be exogenously controlled, there is evidence than top-down factors also influence first fixations on emotional pictures. For example, participants can saccade to neutral pictures rather than emotional pictures through explicit instructions51. Exogenous saccades are also supposed to be faster than the ones observed in those studies (< 200 ms)61,62. One possibility is, therefore, that preferential initial orienting towards negative pictures imply that these stimuli are relevant to current goals. Another possible influencing factor is the first fixation direction bias for the left hemifield, described in the literature in association with reading and writing habits63,64. In agreement with this idea, further analysis of the first fixation direction in the present study (see Supplementary Information, 1.2, for details) revealed that the probability of first fixating on the picture in the left hemifield was higher than the probability of first fixating on the picture in the right hemifield. This left hemifield bias may have contributed to lowering the validity of this index to measure initial orientation as a function of picture content.
Even though the present eye-tracking study is, to the best of our knowledge, the first to use a dot-probe task with natural scenes, a few others eye-tracking studies have used a dot-probe task with facial stimuli, in the context of social anxiety59,65, social phobia66, generalized anxiety disorder67, or PTSD68. One study focusing on initial orienting of attention found that high trait anxious individuals were more likely to fixate, first, negative faces than neutral faces69. One possible explanation is that, because facial stimuli have greater intrinsic biological relevance than natural scenes, they are more prone to trigger initial vigilance responses18. Conversely, pictures of natural scenes would be more likely to warrant maintained attentional processing due to their greater complexity39. This interpretation remains hypothetical, and further studies should investigate this issue.
The analysis of RT data in the emotional dot-probe task did not reveal any significant AB for negative information, which was also not significantly correlated with trait anxiety. These results support the idea that RT-based measures do not index AB for aversive stimuli in healthy volunteers. One could assume that these results are in line with the previous literature30 as our sample was mainly composed of individuals presenting with low to moderate trait anxiety, and we used longer stimuli durations. However, because eye-tracking results provided a different picture, they can also suggest that classic RT-based measures in dot-probe tasks do not constitute reliable indexes of AB70,71. We cannot exclude either that both RT-based and eye-tracking results regarding the link between trait anxiety and attentional bias would differ for individuals with higher trait anxiety. Future studies should investigate this issue.
It has been argued that it is difficult to differentiate between covert and overt attentional shifts from the RT-based results of emotional dot-probe studies, as most of these studies did not use specific gaze behavior instructions72. The present study measured eye movements, i.e. overt attention, but we cannot exclude that AB to negative stimuli also implies covert attentional shifts. For instance, a maintenance bias towards negative stimuli might occur before the initial fixation47,59. Considering that eye movements follow covert attentional shifts6, greater engagement in, or difficulty in disengaging from, negative stimuli may lead to longer first fixation latency for unpleasant pictures than neutral pictures. However, the difference of first fixation latency between negative and neutral pictures failed to reach significance in the present study (p = 0.057) and was not significantly correlated to trait anxiety. Besides, eyes are in constant motion even when people fixate one specific point in visual space. Interestingly, and despite controversial data73, it is supposed that the direction of microsaccades, which can occur up to three times per second during fixation74, can index covert attentional shifts75,76. Future works measuring eye movements to assess AB to emotional stimuli should consider investigating the direction of microsaccades during fixations to infer covert attentional shifts using the adequate eye-tracking methodology77.
Finally, further research should also consider other relevant variables, notably the age of participants. The present study recruited young adults, and AB towards negative stimuli is likely to be different or even nonsignificant with older adults78. Future studies should try to determine whether anxiety disorders and PTSD are associated with specific patterns of eye movements using the procedure employed in this study. This research would pave the way for the development of new treatments improving the most common procedures based on a modification of the visual dot-probe task79, the efficacy of which is currently debated80,81.
In conclusion, the present study provides new evidence that the emotional content of stimuli influences the time-course of visual attention, in part as a function of trait anxiety. The attentional bias for negative stimuli occurs after the initial orienting of attention, then transiently increases with increasing trait anxiety, and appears to persist longer only in individuals with high trait anxiety, individuals with low trait anxiety instead showing an attentional maintenance bias away from negative pictures at later processing stages.
Thirty-eight participants (mean age = 23 ± 3 years; 26 women) provided informed consent before participating in the present study, which was approved by the local ethics committee (Comité de protection des personnes Nord Ouest IV, France) and was conducted in accordance with the Declaration of Helsinki. All patients had normal or corrected-to-normal vision and lacked any neurological or psychiatric disorders or drug consumption (as assessed by a trained psychiatrist during an exhaustive interview). All had a score on the Montreal Cognitive Assessment (MoCA) test82 of 26 or above. Thirty-six participants were right-handed and 2 were left-handed83.
Given the differences usually observed between men and women in the processing of emotional stimuli84,85, negative and neutral pictures from the IAPS53 were selected according to gender. Each gender-based set included 24 negative stimuli, including pictures associated with death and depicting attacks or injured, afraid or suffering persons, and 24 neutral stimuli, including pictures of inanimate objects or depicting people with neutral expressions or in neutral situations (such as daily activities for instance). Emotional characteristics of the stimuli were assessed from mean values of standardized IAPS ratings for valence (scale of 0–9, in which 0 indicates a very unpleasant picture and 9 indicates a very pleasant picture) and arousal (scale of 0–9, in which 0 indicates very calm and 9 indicates very arousing). Regarding visual characteristics, we computed for each picture average (and standard deviation values, as an index of contrast) luminance and RGB saturation values. Moreover, energy across spatial frequencies was assessed by using the MATLAB script provided by Delplanque et al.86, which separates the different layers (RGB) and performs a grayscale transformation of the pictures. Then, discrete wavelet analysis is performed with Haar discrete bidimensional orthogonal wavelets (eight levels). This transformation provides wavelet coefficient matrices for each level. The energy measure is obtained by averaging the sum of the squared values for these coefficients. Finally, regarding cognitive characteristics, we assessed the complexity of the pictures by considering the JPEG file size (number of kilobytes) and face area by computing the percentage of the area occupied by faces in each picture48. Negative and neutral scenes were tested for differences regarding these emotional, visual, and cognitive factors using Welch’s t-tests for independent samples or Wilcoxon rank-sum tests (when normality assumption was not met). The angular size of the images was 8° (horizontal) × 6° (vertical) at a fixed viewing distance of 1 m, and the distance between the fixation cross and the center of each image was 8°. The pictures were displayed on a gray background.
The stimuli were displayed using a 22″ monitor (AOC, resolution: 1,680 × 1,050; refresh rate: 60 Hz) connected to a PC with an Intel Core i3-2,120 3.30 GHz processor and 3 GB RAM as well as an AMD Radeon HD5450 card. The presentation of stimuli and the recording of responses were performed using the Psychophysics Toolbox Version 387 for MATLAB (R2015a, The MathWorks, Inc., Natick, Massachusetts, United States). Eye movements were recorded using the iViewX Hi-Speed eye tracker from Senso-Motoric Instruments (Teltow, Germany; connected to a PC with an Intel Pentium 4 3.00 GHz processor and 1 GB RAM) at a sampling rate of 350 Hz. The manufacturers report a gaze position accuracy of 0.25°–0.5°.
Upon arrival at the study, participants provided informed consent and completed the trait part of the STAI54. The participant was then presented with a central white square (40° × 40°) containing five calibration points. The participant was asked to fixate on the black dots (center, top right, top left, bottom right, and bottom left) while his/her eye positions were recorded by the system. Once the calibration was completed, the participant started the dot-probe task. A trial was triggered when fixation had been stable for 500 ms. Each trial began with a black fixation cross presented for a randomly selected duration between 500 and 1,500 ms on a gray background, followed by two stimuli, one neutral scene and one negative scene, presented simultaneously for a duration of either 1,000 ms or 2,000 ms (with an equal number of presentations for each presentation duration). A small black dot was randomly presented at the location previously occupied by the negative image (congruent trials) or by the neutral image (incongruent trials). Participants were instructed to focus their gaze on the central cross, then to freely explore the images and finally to indicate as quickly as possible the spatial location (left or right) of the dot by pressing one of two keys. A new trial started immediately after they gave their response. The experiment consisted of one practice block of 10 trials followed by one experimental block of 96 trials (24 pairs × 2 exposure durations × 2 trial types). Trials were presented in a randomized order.
Eye gaze data
Eye-tracking data were analyzed using BeGaze software from SensoMotoric Instruments (Teltow, Germany). Areas of interest corresponding to the location of the negative image and the neutral image were identified and used to determine fixation locations and fixation durations. Only fixations longer than 80 ms were considered in the analyses. The initial orientation of attention was assessed using two indices for each picture type: (1) first fixation direction, which corresponded to the total number of trials in which the first fixation was made on the negative picture type divided by the total number of trials in which the first fixation was made on either the negative picture or the neutral picture, and (2) first fixation latencies. Initial maintenance of attention was assessed by analyzing first fixation durations for each picture type. The overall maintenance of attention was assessed using three indices computed for each exposure duration and picture type: (1) dwell time (i.e., overall gaze duration) served as a global index, (2) total fixation count was considered a reorientation index and (3) average fixation duration was considered a re-engagement index.
RTs corresponded to the time between the presentation of the dot and the button press. Trials with response errors were excluded (0.47% of data). No trial was excluded because of a very fast response time (all RTs ≥ 260 ms). However, some trials with long RTs (more than 2,000 ms) were removed (0.25% of data). Then, trials with RTs more than 2.5 SDs above or less than − 2.5 SDs below the participant's mean were discarded to reduce the influence of outliers (1.89% of data). Individual mean RT was computed for each experimental condition on the remaining trials (representing, on average, 97 ± 2% of the total number of trials). AB was computed for each individual and each exposure duration by subtracting the RT in incongruent conditions from the RT in congruent conditions.
The statistical analyses were performed using the software R studio version 1.2.1335 (RStudio, Inc.).
Eye gaze data
Regarding our first objective, six statistical tests were performed, and statistical significance was accepted at a Bonferroni-adjusted alpha level of 0.008. Paired t-tests (or Wilcoxon signed-rank tests when normality assumption was not met) were performed to determine whether first fixation latencies and first fixation durations differed between negative and neutral pictures. A one-sample t-test was performed to determine whether the probability of first fixation on the negative picture significantly differed from 50 (a probability higher or lower than 50 indicates a bias towards or away from negative stimuli, respectively). Repeated measures analyses of variance (ANOVA) were performed on dwell time, total fixation count, and average fixation duration with valence (negative, neutral) and exposure duration (1,000, 2,000) as within-subject factors. Significant interactions were followed by pairwise comparisons. For these comparisons, statistical significance was accepted at a Bonferroni-adjusted alpha level of 0.004.
Regarding our second objective, six statistical tests were also performed, and like for the first objective, statistical significance was accepted at a Bonferroni-adjusted alpha level of 0.008. Links with trait anxiety were assessed by: (1) performing Pearson (or Spearman when normality assumption was not met) correlation analyses between trait anxiety and the probability of first fixation on the negative pictures, as well as the difference scores between negative and neutral conditions for first fixation latencies and first fixation durations; (2) by adding trait anxiety as a continuous predictor into a second step of the analysis of variance for other variables. In the case of a significant interaction between trait anxiety, exposure duration, and valence, Pearson correlation analyses were conducted between trait anxiety and difference scores according to valence at each exposure duration. For these analyses, statistical significance was accepted at a Bonferroni-adjusted alpha level of 0.004.
For all analyses, the threshold of significance was set at p < 0.05. One-sample t-tests were performed to determine whether AB measured from RTs in the 1,000 ms and 2,000 ms conditions significantly differed from 0. Then, a repeated-measures analysis of variance (ANOVA) was performed on AB measured from RTs with exposure duration as a within-subject factor. Link with trait anxiety was assessed by adding trait anxiety as a continuous predictor into a second step of the analysis of variance.
The datasets generated during the current study are available from the corresponding author on a reasonable request.
Henderson, J. M. Human gaze control during real-world scene perception. Trends Cogn. Sci. 7, 498–504 (2003).
Beauchamp, M. S., Petit, L., Ellmore, T. M., Ingeholm, J. & Haxby, J. V. A parametric fMRI study of overt and covert shifts of visuospatial attention. Neuroimage 14, 310–321 (2001).
de Haan, B., Morgan, P. S. & Rorden, C. Covert orienting of attention and overt eye movements activate identical brain regions. Brain Res. 1204, 102–111 (2008).
Kustov, A. A. & Robinson, D. L. Shared neural control of attentional shifts and eye movements. Nature 384, 74–77 (1996).
Carrasco, M. Visual attention: The past 25 years. Vision Res. 51, 1484–1525 (2011).
Kowler, E., Anderson, E., Dosher, B. & Blaser, E. The role of attention in the programming of saccades. Vision Res. 35, 1897–1916 (1995).
Melcher, D. Predictive remapping of visual features precedes saccadic eye movements. Nat. Neurosci. 10, 903–907 (2007).
Rolfs, M., Jonikaitis, D., Deubel, H. & Cavanagh, P. Predictive remapping of attention across eye movements. Nat. Neurosci. 14, 252–258 (2011).
Posner, M. I. Orienting of attention. Q. J. Exp. Psychol. 32, 3–25 (1980).
Zhao, M., Gersch, T. M., Schnitzer, B. S., Dosher, B. A. & Kowler, E. Eye movements and attention: The role of pre-saccadic shifts of attention in perception, memory and the control of saccades. Vision Res. 74, 40–60 (2012).
Corbetta, M. & Shulman, G. L. Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 3, 215–229 (2002).
Posner, M. I., Snyder, C. R. & Davidson, B. J. Attention and the detection of signals. J. Exp. Psychol. Gen. 109, 160–174 (1980).
Theeuwes, J. Endogenous and exogenous control of visual selection. Perception 23, 429–440 (1994).
Wolfe, J. M. & Horowitz, T. S. What attributes guide the deployment of visual attention and how do they do it?. Nat. Rev. Neurosci. 5, 495–501 (2004).
Dolcos, F. et al. Neural correlates of emotion-attention interactions: from perception, learning and memory to individual differences and training interventions. Neurosci. Biobehav. Rev. https://doi.org/10.1016/J.NEUBIOREV.2019.08.017 (2019).
Vuilleumier, P. Affective and motivational control of vision. Curr. Opin. Neurol. 28, 29–35 (2015).
Pourtois, G., Schettino, A. & Vuilleumier, P. Brain mechanisms for emotional influences on perception and attention: What is magic and what is not. Biol. Psychol. 92, 492–512 (2013).
Mulckhuyse, M. The influence of emotional stimuli on the oculomotor system: A review of the literature. Cogn. Affect. Behav. Neurosci. 18, 411–425 (2018).
Bishop, S. J. Neural mechanisms underlying selective attention to threat. Ann. N.Y. Acad. Sci. 1129, 141–152 (2008).
Barbot, A. & Carrasco, M. Emotion and anxiety potentiate the way attention alters visual appearance. Sci. Rep. 8, 1–10 (2018).
Mogg, K. & Bradley, B. P. Anxiety and attention to threat: Cognitive mechanisms and treatment with attention bias modification. Behav. Res. Ther. 87, 76–108 (2016).
Mogg, K. & Bradley, B. P. Anxiety and threat-related attention : cognitive-motivational framework and treatment. Trends Cogn. Sci. 22, 225–240 (2018).
Beck, A. T. & Clark, D. A. An information processing model of anxiety: Automatic and strategic processes. Behav. Res. Ther. 35, 49–58 (1997).
Eysenck, M. W., Derakshan, N., Santos, R. & Calvo, M. G. Anxiety and cognitive performance: Attentional control theory. Emotion 7, 336–353 (2007).
Mathews, A. & Mackintosh, B. A cognitive model of selective processing in anxiety. Cognit. Ther. Res. 22, 539–560 (1998).
Mogg, K. & Bradley, B. P. A cognitive-motivational analysis of anxiety. Behav. Res. Ther. 36, 809–848 (1998).
Williams, J. M. G., Watts, F. N., MacLeod, C. & Mathews, A. Cognitive Psychology and Emotional Disorders (Wiley, Oxford, 1988).
Chambers, J. A., Power, K. G. & Durham, R. C. The relationship between trait vulnerability and anxiety and depressive diagnoses at long-term follow-up of generalized anxiety disorder. J. Anxiety Disord. 18, 587–607 (2004).
Sandi, C. & Richter-Levin, G. From high anxiety trait to depression: A neurocognitive hypothesis. Trends Neurosci. 32, 312–320 (2009).
Bar-Haim, Y., Lamy, D., Pergamin, L., Bakermans-Kranenburg, M. J. & van IJzendoorn, M. H. Threat-related attentional bias in anxious and nonanxious individuals: A meta-analytic study. Psychol. Bull. 133, 1–24 (2007).
Cisler, J. M. & Koster, E. H. W. Mechanisms of attentional biases towards threat in anxiety disorders: An integrative review. Clin. Psychol. Rev. 30, 203–216 (2010).
MacLeod, C., Mathews, A. & Tata, P. Attentional bias in emotional disorders. J. Abnorm. Psychol. 95, 15–20 (1986).
Weierich, M. R., Treat, T. A. & Hollingworth, A. Theories and measurement of visual attentional processing in anxiety. Cogn.Emot. 22, 985–1018 (2008).
Fox, E., Russo, R., Bowles, R. & Dutton, K. Do threatening stimuli draw or hold visual attention in subclinical anxiety?. J. Exp. Psychol. Gen. https://doi.org/10.1037/0096-34184.108.40.2061 (2001).
Bishop, S. J. Neurocognitive mechanisms of anxiety: an integrative account. Trends Cogn. Sci. 11, 307–316 (2007).
Bishop, S. J. Trait anxiety and impoverished prefrontal control of attention. Nat. Neurosci. 12, 92–98 (2009).
Bradley, B. P., Mogg, K., Falla, S. J. & Hamilton, L. R. Attentional bias for threatening facial expressions in anxiety: Manipulation of stimulus duration. Cogn. Emot. 12, 737–753 (1998).
Mogg, K., Bradley, B. P., De Bono, J. & Painter, M. Time course of attentional bias for threat information in non-clinical anxiety. Behav. Res. Ther. 35, 297–303 (1997).
Mogg, K., Bradley, B. P., Miles, F. & Dixon, R. Time course of attentional bias for threat scenes: Testing the vigilance-avoidance hyporthesis. Cogn. Emot. 18, 689–700 (2004).
Koster, E. H. W., Verschuere, B., Crombez, G. & Van Damme, S. Time-course of attention for threatening pictures in high and low trait anxiety. Behav. Res. Ther. 43, 1087–1098 (2005).
MacLeod, C., Grafton, B. & Notebaert, L. Anxiety-linked attentional bias: Is it reliable?. Annu. Rev. Clin. Psychol. 15, 529–554 (2019).
McNally, R. J. Attentional bias for threat: Crisis or opportunity?. Clin. Psychol. Rev. 69, 4–13 (2019).
Bögels, S. M. & Mansell, W. Attention processes in the maintenance and treatment of social phobia: Hypervigilance, avoidance and self-focused attention. Clin. Psychol. Rev. 24, 827–856 (2004).
Kruijt, A.-W., Parsons, S. & Fox, E. A meta-analysis of bias at baseline in RCTs of attention bias modification: No evidence for dot-probe bias towards threat in clinical anxiety and PTSD. J. Abnorm. Psychol. 128, 563–573 (2019).
Hermans, D., Vansteenwegen, D. & Eelen, P. Eye movement registration as a continuous index of attention deployment: Data from a group of spider anxious students. Cogn. Emot. 13, 419–434 (1999).
Quigley, L., Nelson, A. L., Carriere, J., Smilek, D. & Purdon, C. The effects of trait and state anxiety on attention to emotional images: An eye-tracking study. Cogn. Emot. 26, 1390–1411 (2012).
Armstrong, T. & Olatunji, B. O. Eye tracking of attention in the affective disorders: A meta-analytic review and synthesis. Clin. Psychol. Rev. https://doi.org/10.1016/j.cpr.2012.09.004 (2012).
Calvo, M. G. & Lang, P. J. Gaze patterns when looking at emotional pictures: Motivationally biased attention. Motiv. Emot. 28, 221–243 (2004).
Calvo, M. G. & Lang, P. J. Parafoveal semantic processing of emotional visual scenes. J. Exp. Psychol. Hum. Percept. Perform. 31, 502–519 (2005).
Calvo, M. G., Nummenmaa, L. & Hyönä, J. Emotional scenes in peripheral vision: Selective orienting and gist processing, but not content identification. Emotion 8, 68–80 (2008).
Nummenmaa, L., Hyönä, J. & Calvo, M. G. Eye movement assessment of selective attentional capture by emotional pictures. Emotion 6, 257–268 (2006).
Calvo, M. G. & Avero, P. Time course of attentional bias to emotional scenes in anxiety: Gaze direction and duration. Cogn. Emot. 19, 433–451 (2005).
Lang, P. J., Bradley, M. M. & Cuthbert, B. N. International Affective Picture System\r(IAPS): Affective Ratings of Pictures and Instruction Manual. Technical Report A-8 (2008).
Spielberger, C. D., Bruchon-Schweitzer, M. & Paulhan, I. Inventaire d’anxiété état-trait forme Y (STAI-Y) : [manuel]. (Les éditions du centre de psychologie appliquée, 1993).
Orquin, J. L. & Holmqvist, K. Threats to the validity of eye-movement research in psychology. Behav. Res. Methods 50, 1645–1656 (2018).
Rayner, K. Eye movements and attention in reading, scene perception, and visual search. Q. J. Exp. Psychol. 62, 1457–1506 (2009).
Yarbus, A. L. Eye Movements and Vision (1967).
Hsee, C. K., Yang, A. X. & Wang, L. Idleness aversion and the need for justifiable busyness. Psychol. Sci. 21, 926–930 (2010).
Garner, M., Mogg, K. & Bradley, B. P. Orienting and maintenance of gaze to facial expressions in social anxiety. J. Abnorm. Psychol. 115, 760–770 (2006).
Orquin, J. L. & Mueller Loose, S. Attention and choice: A review on eye movements in decision making. Acta Psychol. Amst. 144, 190–206 (2013).
Godijn, R. & Theeuwes, J. Programming of endogenous and exogenous saccades: Evidence for a competitive integration model. J. Exp. Psychol. Hum. Percept. Perform. 28, 1039–1054 (2002).
Henik, A., Rafal, R. & Rhodes, D. Endogenously generated and visually guided saccades after lesions of the human frontal eye fields. J. Cogn. Neurosci. 6, 400–411 (1994).
Foulsham, T., Gray, A., Nasiopoulos, E. & Kingstone, A. Leftward biases in picture scanning and line bisection: A gaze-contingent window study. Vision Res. 78, 14–25 (2013).
Nuthmann, A. & Matthias, E. Time course of pseudoneglect in scene viewing. Cortex 52, 113–119 (2014).
Schofield, C. A., Johnson, A. L., Inhoff, A. W. & Coles, M. E. Social anxiety and difficulty disengaging threat: Evidence from eye-tracking. Cogn. Emot. 26, 300–311 (2012).
Stevens, S., Rist, F. & Gerlach, A. L. Eye movement assessment in individuals with social phobia: Differential usefulness for varying presentation times?. J. Behav. Ther. Exp. Psychiatry 42, 219–224 (2011).
Mogg, K., Millar, N. & Bradley, B. P. Biases in eye movements to threatening facial expressions in generalized anxiety disorder and depressive disorder. J. Abnorm. Psychol. 109, 695–704 (2000).
Powers, A. et al. Attention bias toward threatening faces in women with PTSD: Eye tracking correlates by symptom cluster. Eur. J. Psychotraumatol. 10, 1568133 (2019).
Mogg, K., Garner, M. & Bradley, B. P. Anxiety and orienting of gaze to angry and fearful faces. Biol. Psychol. 76, 163–169 (2007).
Evans, T. C. & Britton, J. C. Improving the psychometric properties of dot-probe attention measures using response-based computation. J. Behav. Ther. Exp. Psychiatry 60, 95–103 (2018).
Schmukle, S. C. Unreliability of the dot probe task. Eur. J. Pers. 19, 595–605 (2005).
Petrova, K., Wentura, D. & Bermeitinger, C. What happens during the stimulus onset asynchrony in the dot-probe task? Exploring the role of eye movements in the assessment of attentional biases. PLoS ONE 8, 1–7 (2013).
Horowitz, T. S., Fine, E. M., Fencsik, D. E., Yurgenson, S. & Wolfe, J. M. Fixational eye movements are not an index of covert attention. Psychol. Sci. 18, 356–363 (2007).
Kowler, E. Eye movements: The past 25 years. Vision Res. 51, 1457–1483 (2011).
Laubrock, J., Kliegl, R., Rolfs, M. & Engbert, R. When do microsaccades follow spatial attention?. Atten. Percept. Psychophys. 72, 683–694 (2010).
Yuval-Greenberg, S., Merriam, E. P. & Heeger, D. J. Spontaneous microsaccades reflect shifts in covert attention. J. Neurosci. 34, 13693–13700 (2014).
Poletti, M. & Rucci, M. A compact field guide to the study of microsaccades: Challenges and functions. Vision Res. 118, 83–97 (2016).
Namaky, N. et al. Moderators of age effects on attention bias toward threat and its association with anxiety. J. Affect. Disord. 216, 46–57 (2017).
MacLeod, C., Rutherford, E., Campbell, L., Ebsworthy, G. & Holker, L. Selective attention and emotional vulnerability: Assessing the causal basis of their association through the experimental manipulation of attentional bias. J. Abnorm. Psychol. 111, 107–123 (2002).
Cristea, I. A., Kok, R. N. & Cuijpers, P. Efficacy of cognitive bias modification interventions in anxiety and depression: Meta-analysis. Br. J. Psychiatry 206, 7–16 (2015).
Grafton, B. et al. Confusing procedures with process when appraising the impact of cognitive bias modification on emotional vulnerability. Br. J. Psychiatry 211, 266–271 (2017).
Nasreddine, Z. S. et al. The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment. J. Am. Geriatr. Soc. 53, 695–699 (2005).
Oldfield, R. C. The assessment and analysis of handedness: The edinburg inventory. Neuropsychologia 9, 97–113 (1971).
Bradley, M. M., Codispoti, M., Sabatinelli, D. & Lang, P. J. Emotion and motivation II: Sex differences in picture processing. Emotion 1, 300–319 (2001).
Collignon, O. et al. Women process multisensory emotion expressions more efficiently than men. Neuropsychologia 48, 220–225 (2010).
Delplanque, S., N’diaye, K., Scherer, K. & Grandjean, D. Spatial frequencies or emotional effects? A systematic measure of spatial frequencies for IAPS pictures by a discrete wavelet analysis. J. Neurosci. Methods 165, 144–150 (2007).
Kleiner, M. et al. What’s new in Psychtoolbox-3. Perception 36, 1 (2007).
This study was supported by a grant from the Fondation Pierre Deniker.
The authors declare no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Veerapa, E., Grandgenevre, P., El Fayoumi, M. et al. Attentional bias towards negative stimuli in healthy individuals and the effects of trait anxiety. Sci Rep 10, 11826 (2020). https://doi.org/10.1038/s41598-020-68490-5
Scientific Reports (2021)
Reproduction-related cognitive processing and distress among young adult women: the role of personal breast cancer history
Cognitive Processing (2021)