Main

We used 48 pairs of pictures, consisting of an original and a modified picture (each displayed for 3 s), each pair presented cyclically with an 80-ms duration ‘mudsplash’ (Fig. 1) superimposed at the moment of the change. There was no disruption in visual continuity at the moment of the change. Ten observers were asked to press a button as soon as they identified the change, which could have been a large object or region of the picture shifting in location, changing colour, or appearing or disappearing. The change could be either a ‘central interest’ or a ‘marginal interest’ element (Fig. 1). Both types of change were equalized for size and salience and were visible under normal conditions without the mudsplash.

Figure 1: Mudsplashes consisted of six small black-and-white textured rectangles or ovals, dispersed over the picture so as not to cover the location of the change.
figure 1

The change in this example consisted of the bar in the background moving down and back up. This was judged to be a ‘marginal interest’ change by a panel of six judges in a previous pilot experiment. Movies of the effects, and further details can be found in Supplementary Information.

Central-interest changes were usually detected as soon as they occurred, whereas marginal-interest changes were seen only on their second or later occurrences. In 13-30% of the cases, marginal-interest changes, although in full view, were not detected at all during the 40-s viewing period.

Part of the explanation for these effects is that attention-grabbing luminance transitions, caused all over the visual field by the brief visual disruptions, prevent attention being focused on the location of the change. But the question remains as to why, once the extraneous transients have subsided, comparison between the current and previous views of the scene is still impossible.

Because the mudsplashes provoke only a minor disturbance, and because they do not cover the location of the change, the change-blindness they cause cannot be due to masking, or to erasure or resetting of the information contained in an internal representation of the visual world. Rather, it seems that change-blindness occurs because the internal representation of the visual world is rather sparse and essentially contains only central-interest information. A second experiment confirmed this.

Instead of mudsplashes, a single black-and-white textured rectangle briefly covered the change location at the moment of the change. This method allowed us to draw attention to the change location without giving away the exact nature of the change. When the change was in a central-interest element, observers were generally able to tell immediately what the change was. This confirms that the masking rectangle was not somehow wiping out the internal representation, and it shows that observers had coded the content of central-interest elements. When the change concerned a marginal-interest element, observers were often unable to determine what it was, showing that observers had not coded the content of marginal-interest elements.

These results indicate that humans' internal representation of the visual field is much sparser than the subjective experience of ‘seeing’ suggests. Only the parts of the environment that observers attend to and encode as interesting are available for making comparisons. Similar inferences have been made for sensory visual memory8, but in these older experiments, simple, artificial stimuli were used, presented for only fractions of a second, whereas we presented natural visual scenes for several seconds and used very large changes.

If only attended parts of the environment are represented in the brain, how can we have the impression of such richness and completeness in the visual world outside us? The answer might be that the visual world acts as an external memory9. We have the impression of simultaneously seeing everything, because any portion of the visual field that awakens our interest is immediately available for scrutiny through an unconscious flick of the eye or of attention. However, those parts of the scene that are not being currently processed (and are in some sense not ‘seen’) nevertheless constitute a background or setting that enlivens our visual experience.

The idea of the world as an outside memory is receiving attention from scientists and philosophers interested in the problem of perceptual ‘filling in’10 of visual scotomas and illusory contours. Work in robotics with the concept of ‘active’ vision is also adopting the notion that using the outside world to represent information might be more efficient than making an internal copy.