In a recent review, Komatsu1 concluded that there is substantial evidence for neural mechanisms underlying the filling-in of visual properties such as contours, texture, brightness and colour. Komatsu1 stressed, however, that the evidence for filling-in depends on the details of the experiment and the type of filling-in phenomenon under investigation. We suggest here that recent human functional MRI (fMRI) studies provide a key to understanding what is and what is not filled-in during filling-in. In agreement with previous neurophysiological studies that failed to find evidence for neural surface filling-in2,3, these fMRI studies did not provide evidence that activity in the early visual cortex corresponds in a topographic (isomorphic) manner with illusory surface regions4,5. These recent findings conflict with some other fMRI reports in favour of isomorphic surface filling-in6,7 and with various studies of surface filling-in observed at the level of single neurons in monkey and cat visual cortices8,9,10,11,12,13,14.
How might these various findings be reconciled? Cornelissen et al.5 recently reported that fMRI activity elicited by luminance and colour edges is accurately modelled by assuming a linear combination of short-range (∼1 mm along cortical surface) and long-range (> 15 mm) responses (Fig. 1a,b). Both short- and long-range responses are symmetrical (Gaussian) with respect to the inducing edge and therefore neither corresponds topographically with surface brightness and colour. The long-range component of these responses — which extend up to 5 degrees away from the stimulus edge, similar to the non-classical receptive field properties of single neurons — calls into question the validity of positive fMRI and neurophysiological reports of cortical surface filling-in. Stated plainly, many positive reports of surface filling-in can be understood as an artefact of long-range cortical responses to edge stimuli. The fMRI activity maps of Sasaki and Watanabe6, for example, are qualitatively more consistent with long-range edge-centred responses than uniformly filled-in surface responses (Fig. 1c). Recent modelling of the responses of single neurons of the primary visual cortex to stimuli that induce illusory brightness contrast8 supports the notion that long-range cortical responses are unrelated to surface filling-in in most surface responsive neurons15.
Future studies of filling-in also need to distinguish between the filling-in of contour and surface information. For example, Meng et al.7 showed that the perception of illusory visual phantoms is correlated with fMRI activity in the primary visual cortex. The authors' stimuli induce the perception of strong illusory contours, along with a weaker surface filling-in effect. Although we do not question the evidence for the completion of illusory contours in the visual cortex, we do emphasize that the case in favour of cortical surface filling-in is weakened by recent findings.
References
Komatsu, H. The neural mechanisms of perceptual filling-in. Nature Rev. Neurosci. 7, 220–231 (2006).
Friedman, H. S., Zhou, H. & von der Heydt, R. The coding of uniform colour figures in monkey visual cortex. J. Physiol. 548, 593–613 (2003).
von der Heydt, R., Friedman, H. S. & Zhou, H. in Filling-in: From Perceptual Completion to Skill Learning (eds Pessoa, L. & De Weerd, P.) 106–127 (Oxford Univ. Press, New York, 2003).
Perna, A., Tosetti, M., Montanaro, D. & Morrone, M. C. Neuronal mechanisms for illusory brightness perception in humans. Neuron 47, 645–651 (2005).
Cornelissen, F. W., Wade, A. R., Vladusich, T., Dougherty, R. F. & Wandell, B. No functional magnetic resonance imaging evidence for brightness and colour filling-in in early human visual cortex. J. Neurosci. 26, 3634–3641 (2006).
Sasaki, Y. & Watanabe, T. The primary visual cortex fills in color. Proc. Natl Acad. Sci. USA 101, 18251–18256 (2004).
Meng, M., Remus, D. A. & Tong, F. Filling-in of visual phantoms in the human brain. Nature Neurosci. 8, 1248–1254 (2005).
Kinoshita, M. & Komatsu, H. Neural representation of the luminance and brightness of a uniform surface in the macaque primary visual cortex. J. Neurophysiol. 86, 2559–2570 (2001).
Rossi, A. F., Rittenhouse, C. D. & Paradiso, M. A. The representation of brightness in primary visual cortex. Science 273, 1104–1107 (1996).
Rossi, A. F. & Paradiso, M. A. Neural correlates of perceived brightness in the retina, lateral geniculate nucleus, and striate cortex. J. Neurosci. 19, 6145–6156 (1999).
Peng, X. & Van Essen, D. C. Peaked encoding of relative luminance in macaque areas V1 and V2. J. Neurophysiol. 93, 1620–1632 (2005).
MacEvoy, S. P. & Paradiso, M. A. Lightness constancy in primary visual cortex. Proc. Natl Acad. Sci. USA 98, 8827–8831 (2001).
Hung, C. P., Ramsden, B. M., Chen, L. M. & Roe, A. W. Building surfaces from borders in Areas 17 and 18 of the cat. Vision Res. 41, 1389–1407 (2001).
Roe, A. W., Lu, H. D. & Hung, C. P. Cortical processing of a brightness illusion. Proc. Natl Acad. Sci. USA 102, 3869–3874 (2005).
Vladusich, T., Lucassen, M. P. & Cornelissen, F. W. Do cortical neurons process luminance or contrast to encode surface properties? J. Neurophysiol 95, 2638–2649 (2006).
Acknowledgements
F.W.C. and T.V. are supported by a grant from the Cognition Program of the Netherlands Organization for Scientific Research (NWO) and the School of Behavioural and Cognitive Neurosciences.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Cornelissen, F., Vladusich, T. What gets filled-in during filling-in?. Nat Rev Neurosci 7, 828 (2006). https://doi.org/10.1038/nrn1869-c1
Issue Date:
DOI: https://doi.org/10.1038/nrn1869-c1