Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Article
  • Published:

Backward masking in mice requires visual cortex

Abstract

Visual masking can reveal the timescale of perception, but the underlying circuit mechanisms are not understood. Here we describe a backward masking task in mice and humans in which the location of a stimulus is potently masked. Humans report reduced subjective visibility that tracks behavioral deficits. In mice, both masking and optogenetic silencing of visual cortex (V1) reduce performance over a similar timecourse but have distinct effects on response rates and accuracy. Activity in V1 is consistent with masked behavior when quantified over long, but not short, time windows. A dual accumulator model recapitulates both mouse and human behavior. The model and subjects’ performance imply that the initial spikes in V1 can trigger a correct response, but subsequent V1 activity degrades performance. Supporting this hypothesis, optogenetically suppressing mask-evoked activity in V1 fully restores accurate behavior. Together, these results demonstrate that mice, like humans, are susceptible to masking and that target and mask information is first confounded downstream of V1.

This is a preview of subscription content, access via your institution

Access options

Buy this article

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Backward visual masking impairs discrimination of target location.
Fig. 2: Visual cortical activity during a 50-ms window is required for target detection.
Fig. 3: A dual accumulator model using V1 activity is consistent with the performance and reaction times of mice.
Fig. 4: Optogenetic inhibition of mask-evoked activity in visual cortex rescues accuracy of behavioral responses.

Similar content being viewed by others

Data availability

Data is deposited on figshare at https://doi.org/10.6084/m9.figshare.24135018.v1.

Code availability

Code is available on GitHub at https://github.com/samgale/Masking.

References

  1. Dehaene, S. Consciousness and the Brain: Deciphering How the Brain Codes Our Thoughts (Penguin, 2014).

  2. Breitmeyer, B. & Ogmen, H. Visual Masking: Time Slices Through Conscious and Unconscious Vision (Oxford Univ. Press, 2006).

  3. Bachmann, T. & Francis, G. Visual Masking: Studying Perception, Attention, and Consciousness (Academic, 2013).

  4. Alpern, M. Metacontrast. J. Opt. Soc. Am. 43, 648–657 (1953).

    CAS  PubMed  Google Scholar 

  5. Battersby, W. & Sturr, J. Neural limitations of visual excitability. J. Opt. Soc. Am. 60, 121–126 (1970).

    CAS  PubMed  Google Scholar 

  6. Macknik, S. L. & Martinez-Conde, S. The spatial and temporal effects of lateral inhibitory networks and their relevance to the visibility of spatiotemporal edges. Neurocomputing 58–60, 775–782 (2004).

    Google Scholar 

  7. Öǧmen, H. A neural theory of retino-cortical dynamics. Neural Netw. 6, 245–273 (1993).

    Google Scholar 

  8. Lamme, V. A. F., Zipser, K. & Spekreijse, H. Masking interrupts figure-ground signals in V1. J. Cogn. Neurosci. 14, 1044–1053 (2002).

    PubMed  Google Scholar 

  9. Ro, T., Breitmeyer, B., Burton, P., Singhal, N. S. & Lane, D. Feedback contributions to visual awareness in human occipital cortex. Curr. Biol. 13, 1038–1041 (2003).

    CAS  Google Scholar 

  10. Eriksen, C. W. & Hoffman, M. Form recognition at brief durations as a function of adapting field and interval between stimulations. J. Exp. Psychol. 66, 485–499 (1963).

    CAS  Google Scholar 

  11. Thompson, J. H. What happens to the stimulus in backward masking? J. Exp. Psychol. 71, 580–586 (1966).

    CAS  PubMed  Google Scholar 

  12. Schultz, D. W. & Eriksen, C. W. Do noise masks terminate target processing? Mem. Cogn. 5, 90–96 (1977).

    CAS  Google Scholar 

  13. Schiller, P. H. Monoptic and dichoptic visual masking by patterns and flashes. J. Exp. Psychol. 69, 193–199 (1965).

    CAS  PubMed  Google Scholar 

  14. Kinsbourne, M. & Warrington, E. K. Further studies on the masking of brief visual stimuli by a random pattern. Q. J. Exp. Psychol. 14, 235–245 (1962).

    Google Scholar 

  15. Green, M. F. et al. Regional brain activity associated with visual backward masking. J. Cogn. Neurosci. 17, 13–23 (2005).

    PubMed  Google Scholar 

  16. Haynes, J. D., Driver, J. & Rees, G. Visibility reflects dynamic changes of effective connectivity between V1 and fusiform cortex. Neuron 46, 811–821 (2005).

    CAS  Google Scholar 

  17. Tse, P. U., Martinez-Conde, S., Schlegel, A. A. & Macknik, S. L. Visibility, visual awareness, and visual masking of simple unattended targets are confined to areas in the occipital cortex beyond human V1/V2. Proc. Natl Acad. Sci. USA 102, 17178–17183 (2005).

    CAS  PubMed  PubMed Central  Google Scholar 

  18. Coenen, A. M. L. & Eijkman, E. G. J. Cat optic tract and geniculate unit responses corresponding to human visual masking effects. Exp. Brain Res. 15, 441 (1972).

    CAS  PubMed  Google Scholar 

  19. Macknik, S. L. & Martinez-Conde, S. Dichoptic visual masking reveals that early binocular neurons exhibit weak interocular suppression: implications for binocular vision and visual awareness. J. Cogn. Neurosci. 16, 1049–1059 (2004).

    Google Scholar 

  20. Schiller, P. H. Single unit analysis of backward visual masking and metacontrast in the cat lateral geniculate nucleus. Vis. Res. 8, 855–866 (1968).

    CAS  PubMed  Google Scholar 

  21. Bridgeman, B. Temporal response characteristics of cells in monkey striate cortex measured with metacontrast masking and brightness discrimination. Brain Res. 196, 347–364 (1980).

    CAS  PubMed  Google Scholar 

  22. Macknik, S. L. & Livingstone, M. S. Neuronal correlates of visibility and invisibility in the primate visual system. Nat. Neurosci. 1, 144–149 (1998).

    CAS  PubMed  Google Scholar 

  23. Maeda, K. et al. Neural correlates of color-selective metacontrast in human early retinotopic areas. J. Neurophysiol. 104, 2291–2301 (2010).

    PubMed  Google Scholar 

  24. Rolls, E. T., Tovée, M. J. & Panzeri, S. The neurophysiology of backward visual masking: information analysis. J. Cogn. Neurosci. 11, 300–311 (1999).

    CAS  PubMed  Google Scholar 

  25. Kovács, G., Vogels, R. & Orban, G. A. Cortical correlate of pattern backward masking. Proc. Natl Acad. Sci. USA 92, 5587–5591 (1995).

    PubMed Central  Google Scholar 

  26. Rolls, E. T. & Tovee, M. J. Processing speed in the cerebral cortex and the neurophysiology of visual masking. Proc. R. Soc. Lond. Ser. B Biol. Sci. 257, 9–15 (1994).

    CAS  Google Scholar 

  27. Burgess, C. P. et al. High-yield methods for accurate two-alternative visual psychophysics in head-fixed mice. Cell Rep. 20, 2513–2524 (2017).

    CAS  PubMed  PubMed Central  Google Scholar 

  28. Busse, L. et al. The detection of visual contrast in the behaving mouse. J. Neurosci. 31, 11351–11361 (2011).

    CAS  PubMed Central  Google Scholar 

  29. Glickfeld, L. L., Histed, M. H. & Maunsell, J. H. R. Mouse primary visual cortex is used to detect both orientation and contrast changes. J. Neurosci. 33, 19416–19422 (2013).

    CAS  PubMed Central  Google Scholar 

  30. Garrett, M. E. et al. Experience shapes activity dynamics and stimulus coding of VIP inhibitory and excitatory cells in visual cortex. eLife 9, e50340 (2020).

    CAS  PubMed  PubMed Central  Google Scholar 

  31. Andermann, M. L., Kerlin, A. M. & Reid, R. C. Chronic cellular imaging of mouse visual cortex during operant behavior and passive viewing. Front. Cell. Neurosci. 4, 3 (2010).

    PubMed Central  Google Scholar 

  32. Resulaj, A., Ruediger, S., Olsen, S. R. & Scanziani, M. First spikes in visual cortex enable perceptual discrimination. eLife 7, e34044 (2018).

    PubMed  PubMed Central  Google Scholar 

  33. Dell, K. L., Arabzadeh, E., Chiang, N. S. & Id, P. Human-like perceptual masking is difficult to observe in rats performing an orientation discrimination task. PLoS ONE 13, e0207179 (2018).

    PubMed Central  Google Scholar 

  34. Watanabe, M., Totah, N., Löwe, S., Kaiser, K. & Logothetis, N. Visual backward masking in rats: a behavioral task for studying the neural mechanisms of visual awareness. In Society for Neuroscience Meeting https://doi.org/10.13140/2.1.2519.2648 (Society for Neuroscience, 2014).

  35. Francis, G. & Cho, Y. S. Effects of temporal integration on the shape of visual backward masking functions. J. Exp. Psychol. Hum. Percept. Perform. 34, 1116–1128 (2008).

    PubMed  Google Scholar 

  36. Crouzet, S. M., Overgaard, M. & Busch, N. A. The fastest saccadic responses escape visual masking. PLoS ONE 9, e87418 (2014).

    PubMed Central  Google Scholar 

  37. Li, N. Spatiotemporal constraints on optogenetic inactivation in cortical circuits. eLife 8, e48622 (2019).

    CAS  PubMed  PubMed Central  Google Scholar 

  38. Bennett, C. et al. Higher-order thalamic circuits channel parallel streams of visual information in mice. Neuron 102, 477–492.e5 (2019).

    CAS  PubMed  PubMed Central  Google Scholar 

  39. Smith, P. L. & Ratcliff, R. Psychology and neurobiology of simple decisions. Trends Neurosci. 27, 161–168 (2004).

    CAS  PubMed  Google Scholar 

  40. Gold, J. I. & Shadlen, M. N. The neural basis of decision making. Annu. Rev. Neurosci. 30, 535–574 (2007).

    CAS  PubMed  Google Scholar 

  41. International Brain Laboratory et al. Standardized and reproducible measurement of decision-making in mice. eLife 10, e63711 (2021).

    Google Scholar 

  42. Kolers, P. A. Intensity and contour effects in visual masking. Vis. Res. 2, 277–294 (1962).

    Google Scholar 

  43. Kinsbourne, M. & Warrington, E. K. The effect of an after-coming random pattern on the perception of brief visual stimuli. Q. J. Exp. Psychol. 14, 223–234 (1962).

    Google Scholar 

  44. Eriksen, C. W. & Lappin, J. S. Luminance summation-contrast reduction as a basis for certain forward and backward masking effects. Psychon. Sci. 1, 313–314 (1964).

    Google Scholar 

  45. Sperling, G. Temporal and spatial visual masking i masking by impulse flashes. J. Opt. Soc. Am. 55, 541 (1965).

    Google Scholar 

  46. Bacon-Macé, N., Macé, M. J. M., Fabre-Thorpe, M. & Thorpe, S. J. The time course of visual processing: backward masking and natural scene categorisation. Vis. Res. 45, 1459–1469 (2005).

    Google Scholar 

  47. Ellis, E. M., Gauvain, G., Sivyer, B. & Murphy, G. J. Shared and distinct retinal input to the mouse superior colliculus and dorsal lateral geniculate nucleus. J. Neurophysiol. 116, 602–610 (2016).

    CAS  PubMed  PubMed Central  Google Scholar 

  48. Amassian, V. E. et al. Unmasking human visual perception with the magnetic coil and its relationship to hemispheric asymmetry. Brain Res. 605, 312–316 (1993).

    CAS  Google Scholar 

  49. Thorpe, S., Fize, D. & Marlot, C. Speed of processing in the human visual system. Am. J. Ophthalmol. 122, 608–609 (1996).

    Google Scholar 

  50. Van Rullen, R. & Koch, C. Visual selective behavior can be triggered by a feed-forward process. J. Cogn. Neurosci. 15, 209–217 (2003).

    Google Scholar 

  51. Crouzet, S. M., Kovalenko, L. Y., del Pin, S. H., Overgaard, M. & Busch, N. A. Early visual processing allows for selective behavior, shifts of attention, and conscious visual experience in spite of masking. Conscious. Cogn. 54, 89–100 (2017).

    PubMed  Google Scholar 

  52. Ratcliff, R. & Rouder, J. N. A diffusion model account of masking in two-choice letter identification. J. Exp. Psychol. Hum. Percept. Perform. 26, 127–140 (2000).

    CAS  PubMed  Google Scholar 

  53. Vorberg, D., Mattler, U., Heinecke, A., Schmidt, T. & Schwarzbach, J. Different time courses for visual perception and action priming. Proc. Natl Acad. Sci. USA 100, 6275–6280 (2003).

    CAS  PubMed  PubMed Central  Google Scholar 

  54. Kepecs, A., Uchida, N., Zariwala, H. A. & Mainen, Z. F. Neural correlates, computation and behavioural impact of decision confidence. Nature 455, 227–231 (2008).

    CAS  PubMed  Google Scholar 

  55. Kepecs, A. & Mainen, Z. F. A computational framework for the study of confidence in humans and animals. Philos. Trans. R. Soc. Lond. B Biol. Sci. 367, 1322–1337 (2012).

    PubMed  PubMed Central  Google Scholar 

  56. Zhao, S. et al. Cell type-specific channelrhodopsin-2 transgenic mice for optogenetic dissection of neural circuitry function. Nat. Methods 8, 745–752 (2011).

    CAS  PubMed Central  Google Scholar 

  57. Peirce, J. W. Generating stimuli for neuroscience using PsychoPy. Front. Neuroinform. 2, 10 (2009).

    PubMed Central  Google Scholar 

  58. Jun, J. J. et al. Fully integrated silicon probes for high-density recording of neural activity. Nature 551, 232–236 (2017).

    CAS  PubMed  PubMed Central  Google Scholar 

  59. Siegle, J. H. et al. Open Ephys: an open-source, plugin-based platform for multichannel electrophysiology. J. Neural Eng. 14, 045003 (2017).

    PubMed  Google Scholar 

  60. Stringer, C. et al. Spontaneous behaviors drive multidimensional, brainwide activity. Science 364, 255 (2019).

    PubMed  PubMed Central  Google Scholar 

  61. Hill, D. N., Mehta, S. B. & Kleinfeld, D. Quality metrics to accompany spike sorting of extracellular signals. J. Neurosci. 31, 8699–8705 (2011).

    CAS  PubMed  PubMed Central  Google Scholar 

  62. Siegle, J. H. et al. Survey of spiking in the mouse visual system reveals functional hierarchy. Nature 592, 86–92 (2021).

    CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We thank the Allen Institute founder, P. G. Allen, for his vision, encouragement and support. We thank the Allen Institute Neurosurgery and Behavior team for help with mouse surgeries. We thank S. Naylor for support with program management. We thank S. Reynolds for help with administration of the animal and human protocols. We thank M. Watanabe and D. Ollerenshaw for discussion of masking paradigms in rodents. We thank the Tiny Blue Dot Foundation for providing funding for this study. The funders had no role in study design, data collection and analysis, decision to publish or preparation of the paper.

Author information

Authors and Affiliations

Authors

Contributions

S.D.G., C.B., C.K. and S.R.O. conceived the project. S.D.G., C.S., C.B. and S.R.O. developed the mouse and human experimental methodology. S.D.G. and C.S. performed the experiments. S.D.G. and C.B. analyzed the data. S.M. provided advice on modeling and data analysis. C.K. and S.R.O. supervised all aspects of the project. All authors contributed to writing the paper.

Corresponding authors

Correspondence to Christof Koch or Shawn R. Olsen.

Ethics declarations

Competing interests

C.K. holds an executive position, and has financial interest, in Intrinsic Powers, Inc., a company whose purpose is to develop a device that can be used in the clinic to assess the presence and absence of consciousness in patients. This does not pose any conflict of interest with regard to the work undertaken for this publication.

Peer review

Peer review information

Nature Neuroscience thanks the anonymous reviewers for their contribution to the peer review of this work.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Extended data

Extended Data Fig. 1 Sensitivity of task performance in mice to target duration and contrast in the absence of a mask.

Sensitivity of task performance in mice to target duration (a-c) and contrast (d-f) in the absence of a mask. Target contrast was 100% for experiments varying target duration (A-C). Target duration was 17 ms for experiments varying target contrast (D-F). Colored lines are data from single sessions from individual mice (n = 8 wild-type mice, 10 VGAT-ChR2 mice). Black circles are means across mice; error bars represent standard error of the mean.

Extended Data Fig. 2 Statistical comparisons of performance across conditions shown in Fig. 1.

(a,b) p-values from comparison of mouse response rates (A) and accuracy (B) for the conditions shown in Fig. 1b,c. Distributions were compared with a Kruskal-Wallis test followed by pairwise Wilcoxon rank sum tests. p-values were corrected for multiple comparisons using the Benjamini-Hochberg method. Greyness scale is log10 based. Significant p-values (<0.05) are marked by red stars. Non-significant p-values (≥0.05) are white. Redundant or non-tested comparisons are yellow. (c-e) Same as A and B for human subjects (Fig. 1d–f), additionally showing comparisons of subjective visibility ratings (E).

Extended Data Fig. 3 Selection of units and timing of visual responses.

(a) False-positive rate for spikes recorded from 1382 units from 5 wild-type and 4 VGAT-ChR2 mice. The false-positive rate was defined as the refractory-period violation rate (number of spikes within 1.5 ms refractory periods divided by the total duration of refractory periods) divided by the total spike rate (see Methods). Units with a false-positive rate greater than one by this definition are displayed at one in the histogram. 543 units with false-positive rates less than 0.5 were considered for further analysis in this study. (b) Peak-to-trough duration of the average spike waveforms (n = 543). Units with peak-to-trough duration less than 0.4 were classified as fast spiking (FS; putative inhibitory interneurons); all other units were classified as regular spiking (RS; putative pyramidal neurons). (c) Average firing rate of 173 visually responsive units (see Methods) following presentation of a contralateral target (17 ms duration) or bilateral mask (200 ms duration) starting at 0 ms on the x-axis. Shaded area is the standard error of the mean. (d) Cumulative distribution of the median time to first spike (see Methods) of the 173 visually responsive units. There was no significant difference in the time to first spike between target-only (median across units 73.9 ms) and mask-only (71.3 ms) trials (p = 0.22, Wilcoxon rank sum test). There was also no significant difference between the time to first spike of RS (n = 128) and FS (n = 45) units (target only: 75.1 vs. 68.1 ms, p = 0.08; mask only: 71.4 vs. 68.9 ms, p = 0.39), which were combined for the data plotted.

Extended Data Fig. 4 Effect of optogenetic stimulus in V1 neurons in VGAT-ChR2 mice.

(a) Mean response of V1 neurons from 4 VGAT-ChR2 mice to stimulation with blue light. Gray, shaded region indicates standard error of the mean. Fast-spiking (FS, putative interneurons) and regular spiking (RS, putative pyramidal neurons) were defined by the peak-to-trough duration of their spike waveforms. Neurons were classified as excited, transiently excited, or inhibited (see Methods). Two neurons were non-responsive (not shown). The bottom panel expands the time scale (indicated by dashed lines) of the inhibited cells. (b) Mean response of 74 visually-responsive V1 neurons (see Methods) from the same mice in A to the visual and optogenetic stimuli used for the behavior data in Fig. 4a,b. Shaded regions indicate standard error of the mean. Neurons that were excited or transiently excited by the optogenetic light were excluded. Optogenetic light onset was varied relative to the onset of the target presented contralateral or ipsilateral to the recorded neurons. On a subset of trials, the target (17 ms duration) was immediately followed by a bilateral mask for 200 ms.

Extended Data Fig. 5 Statistical comparison of performance accross conditions shown in Fig. 2, effect of unilateral cortical inhibition, and control experiment in wildtype mice.

(a,b) p-values from comparison of response rates (A) and accuracy (B) for the conditions shown in Fig. 2c,d, using statistical procedures described in the legend for Extended Data Fig. 2a,b. (c) Effect of unilateral cortical inhibition on target detection (n = 8 VGAT-ChR2 mice). The inhibited hemisphere(s) are indicated on the x-axis. Optogenetic light onset was 17 ms before target onset. The top plot shows, for trials on which the target was left, the mean fraction of trials that mice moved right (red, correct) or left (blue, incorrect). Error bars represent the standard error the mean. The sum of the red and blue data points for each condition is the response rate. The middle and bottom plots show similar data for target-right and no visual stimulus trials, respectively. (d,e) Effect of optogenetic light stimulus on response rate and accuracy in wild-type mice (n = 8) for the same conditions shown in Fig. 2c,d. Circles are means across mice; error bars represent standard error of the mean.

Extended Data Fig. 6 Cumulative spikes relative to stimulus onset for contralateral or ipsilateral stimuli.

(a) Cumulative stimulus-evoked spikes over 200 ms per V1 neuron (n = 58) following onset of a contralateral target. Spike number was calculated by integrating the trial-averaged post-stimulus time histogram after baseline subtraction for each neuron, and then averaging across neurons. Shaded region surrounding each line represents the standard error of the mean in A-C. (b) Same as A for trials with an ipsilateral target. (c) The average difference of the values quantified in A and B (see also Fig. 3b,c).

Extended Data Fig. 7 Additional reaction time and movement speed data and modeling of human data.

(a) Median reaction times for all responses, correct responses, and incorrect responses from the 16 mice used for Fig. 1b,c. Circles are means across mice and error bars represent standard error of the mean. (b) Comparison of median reaction times for correct and incorrect responses for each mouse. Each circle is data for one condition (mask onset or target only) from one mouse. (c) Cumulative probability distributions of reaction times pooled across the mice for correct (solid lines) and incorrect (dashed lines) responses. Reaction times on mask-only and catch trials are also shown. (d,e) Same as B,C for movement speed. (f-h) Same as A-C for the reaction times of 16 human subjects. (i) Fraction correct versus reaction time after pooling reaction times across all humans in 600 ms bins. Shaded region surrounding each line is the 95% confidence interval given the fraction correct values and the number of pooled trials for each bin (the median number of trials across mask onset conditions was 135, 296, 30, and 28 for the time bins from left to right after excluding conditions from a bin if there were less than 15 trials). (j-l) Response rate, accuracy, and reaction times of the dual accumulator model (open circles) shown in Fig. 3f fit to human behavior data (filled circles with error bars representing the standard error of the mean from 16 humans). (m) Accuracy versus reaction time for the model, corresponding to I for humans.

Extended Data Fig. 8 Statistical comparison of performance across conditions shown in Fig. 4 and control experiment in wild-type mice.

(a,b) p-values from comparison of response rates (A) and accuracy (B) for the conditions shown in Fig. 4a,b, using statistical procedures described in the legend for Extended Data Fig. 2a,b. (c,d) Effect of optogenetic light stimulus on response rate and accuracy in wild-type mice (n = 8) for the same conditions shown in Fig. 4a,b. Circles are means across mice; error bars represent standard error of the mean.

Supplementary information

Supplementary Information

Supplementary Tables 1 and 2.

Reporting Summary

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gale, S.D., Strawder, C., Bennett, C. et al. Backward masking in mice requires visual cortex. Nat Neurosci 27, 129–136 (2024). https://doi.org/10.1038/s41593-023-01488-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41593-023-01488-0

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing