Abstract
Any processing delay between the two eyes can result in illusory 3D percepts for moving objects because of either changes in the pure disparities over time for disparity sensors or by changes to sensors that encode motion/disparity conjointly. This is demonstrated by viewing a fronto-parallel pendulum through a neutral density (ND) filter placed over one eye, resulting in the illusory 3D percept of the pendulum following an elliptical orbit in depth, the so-called Pulfrich phenomenon. Here we use a paradigm where a cylinder rotating in depth, defined by moving Gabor patches is presented at different interocular phases, generating strong to ambiguous depth percepts. This paradigm allows one to manipulate independently the contrast and the luminance of the patches to determine their influence on perceived motion-in-depth. Thus we show psychophysically that an interocular contrast difference can itself result in a similar illusory 3D percept of motion-in-depth. We argue that contrast, like luminance (ND filter) can modify the dynamics of visual neurons resulting in an interocular processing delay or an interocular velocity difference.
Similar content being viewed by others
Introduction
Any processing delay between the two eyes can result in illusory 3D percepts for moving objects because of either changes in the pure disparities over time for disparity sensors1 or by changes to sensors that encode motion/disparity conjointly2. This is demonstrated by viewing a fronto-parallel pendulum through a neutral density filter placed over one eye, resulting in the illusory 3D percept of the pendulum following an elliptical orbit in depth, the so-called Pulfrich phenomenon3.
The monocular delay induced by luminance4 thought to be responsible for the Pulfrich phenomenon has been observed in several species at the level of the retina5, and at the cortical level for both single cell6 and population scales7, 8. In human and non-human primates, binocular neurons in MT, encoding motion-in-depth are sensitive to disparity, interocular velocity differences and delays9,10,11,12,13,14,15, similar to that generated by a monocular luminance decrement, suggesting that the delay induced by a luminance decrement is responsible for the perception of illusory motion-in-depth in the Pulfrich phenomenon16, 17.
However, a luminance decrement is not the only way to increase response latency. From the retina18, LGN19, V120 to MT21, and from the single cells to populations22 and behavior23, it has been observed that a decrement of the stimulus contrast, will also result in an increment in the response latency. Thus, if the binocular cells, integrating the signal coming from the two eyes in the cortex are responsible for the Pulfrich phenomenon because of the delay generated by luminance in one of the monocular streams16, 17, it should be possible that a similar delay, generated by a contrast decrement would generate a similar percept. The binocular fusion of stimuli with different contrasts in the two eyes is possible, with a higher weight attributed to the eye with the highest contrast stimulus24,25,26,27. This change in weighting could be accompanied by a change in the processing time of each eye’s input during the binocular combination.
So far, studies that have focused on a depth perception induced by a monocular contrast change have used random dot patterns in which the background or inducing luminance was manipulated resulting in a combined change in luminance and contrast28, 29. In this study, we use a paradigm where a cylinder rotating in depth, defined by moving Gabor patches is presented at different interocular phases, generating strong to ambiguous depth percepts (Fig. 1, supplementary movies)12, 30. When viewed monocularly or with a zero interocular phase, individuals will likely experience a motion-in-depth percept known as the kinetic depth effect31, 32. However, the low-level interocular phase manipulation creates an actual disparity. This paradigm involves structure-from-motion and depth perception mechanisms12 and allows one to manipulate independently the contrast and the luminance of the patches. This allows for the precise measurement of the interocular delay in terms of the phase difference between the two eyes’ images at the point of subjective equality (PSE) where the cylinder’s clockwise and anticlockwise rotation is ambiguous. The subjects’ task was to report whether they saw the cylinder rotating clockwise or anticlockwise. The interocular phase difference was manipulated for different interocular luminance or contrast conditions.
Results
In Fig. 2a, the psychometric functions are displayed for one subject who reported a clockwise perception as a function of the interocular delay for different luminance conditions. One can see that the psychometric function is shifted to the left when the luminance is decreased over the left eye which means that the cylinder is seen more often rotating clockwise; and that it is shifted to the right when the luminance is decreased over the right eye, meaning that the rotation is seen more anticlockwise. The estimated PSE for changes in the interocular phase is then plotted as a function of the interocular luminance difference in Fig. 2b for all subjects. In the viewing condition with no luminance imbalance (0ND), most subjects’ PSE are offset from 0°, characterizing a “spontaneous Pulfrich phenomenon” in the normal population not previously observed33. When a ND filter is placed in front of one eye, the PSE on average increases from −0.32° at −1ND to 0.26° at + 1ND interocular luminance difference, which corresponds to an average interocular delay of 16 ms. The data are fitted by linear regressions with slopes that are significantly positive for all subjects (mean slope 0.29 ± 0.04, right-tailed Wilcoxon signed rank test, p < 0.001). These results confirm what has been reported by Carkeet et al.34, namely that the interocular temporal asynchrony is dependent on the interocular luminance difference and is symmetrical whether the left or right eye luminance is decreased. Therefore, the amplitude of the luminance-induced Pulfrich phenomenon depends on the interocular luminance difference.
If the depth percept arises from a luminance-induced neural delay, then this phenomenon should be reproducible with a monocular contrast decrement which will also delay the neural processing of one eye. In Fig. 2c, we display psychometric functions similar to that already described in Fig. 2a, but for interocular contrast differences. Here again, we can see that the cylinder is seen more often rotating clockwise when the contrast is decreased in the left eye image; and that it is seen more often rotating anticlockwise when the contrast is decreased in the right eye image.
In Fig. 2d, we plot the estimated PSE for the interocular phase difference as a function of the interocular contrast difference for all subjects, similar to that for luminance in Fig. 2b. On average, it increases from −0.08° at −60% to 0.07° at + 60% interocular contrast difference, which corresponds to an interocular delay of 4 ms. The datapoints are fitted by linear regressions with significantly positive slopes for all subjects (mean slope 0.11 ± 0.07, right-tailed Wilcoxon signed rank test, p < 0.001). These results are novel and show that the interocular temporal asynchrony is dependent on the interocular contrast difference, in a symmetrical way for the left or right eye decrements in contrast. This effect is much smaller than the one observed for luminance reductions but it shows that an interocular contrast difference can generate a Pulfrich phenomenon for a moving stimulus.
To investigate if the effects induced by luminance and contrast share a common mechanism, we report the correlation between the regression slopes of the angular PSE as a function of interocular contrast and luminance difference in Fig. 3 for the 10 subjects. This correlation is strong with a coefficient of determination R 2 = 0.7086 and p = 0.0023 indicating that these two effects likely share a common mechanisms.
Discussion
Spatio-temporal phase shifts can generate a depth perception for moving stimuli35,36,37. This provides the basis for our cylinder stimulus seen rotating in depth when the interocular phase difference is changed. With this protocol, we show that a contrast imbalance between the two eyes can produce an illusory percept of motion-in-depth.
When seeing ambiguous planar motion, individuals will likely experience a motion-in-depth percept due to a bias which could be driven by the kinetic depth effect31, 32. The contrast-dependent phenomenon reported here is very sensitive and can interact with subjects’ innate bias. In Fig. 2d, for all subjects, the PSE shows a clear increasing trend as a function of the interocular contrast difference. The PSE at 0 doesn’t deviates from the trend and, in some cases, this innate bias cannot even be reversed by a small contrast or luminance imbalance (see also Fig. 2b). For some subjects (e.g. S3, S4, S9), it even remains consistently always positive or negative, because the innate bias is stronger than the induced stimulus contrast imbalance. Furthermore, if the phase is kept at 0° (ambiguous case) and only the contrast is changed, some subjects will perceive the stimulus always rotating in the same direction regardless of the contrast imbalance of the stimulus because of the more dominant influence of their innate bias (see Supplementary Figure 1). This could provide an explanation for why a contrast-induced interocular delay has never been observed previously. Due to its consistency over the contrast and luminance range, we therefore suspect this bias to be due to a low-level innate contrast imbalance between the two eyes, revealing a “spontaneous Pulfrich phenomenon”33 rather than being perceptual (the kinetic depth effect). However we cannot totally rule out this possibility.
We observe a larger variability in the slope as a function of the interocular difference in the contrast condition than in the luminance condition. It could be due to the innate variability in the contrast sensitivity of the participants (see Supplementary Figure 2) which falls within the normal range38.
We estimated that a fourfold contrast reduction in the high contrast range induced a delay of approximately 4 ms. This value falls in the same range as what has been observed in monkey primary visual cortex at both the single cell level20, 39, 40 and the population level41, 42. The same kind of delay as a function of contrast has been reported for perceptual judgment43 and in the microsaccade onset time in humans44. Thus, we hypothesized that a contrast-generated delay in neural processing is responsible for the illusory depth percept. Also the correlation we observed between the slopes of the contrast- and luminance-based effect could indicate that they are both mediated by a common contrast-gain control mechanism and hence, that the Pulfrich phenomenon might be partially mediated by a contrast-gain control mechanism. This result could then open new ways of interpretation of this phenomenon. However, an alternate explanation could be advanced that the motion-in-depth could actually be computed via an interocular velocity difference45,46,47. It is known that a reduction of contrast results in the perception of objects moving at a slower speed whether they are moving in depth48 or within a plane23, 49. Thus the reduced contrast Gabor patches seen by one eye could be monocularly perceived as moving more slowly than the high contrast ones seen by the other eye. However, Campbell and Maffei50 reported that a grating is only perceived to rotate more slowly when the contrast is below 0.05, much lower than the contrast for which the effect is observed here. An interocular speed difference could generate a motion-in-depth percept once the two monocular trajectories are combined. In fact, if we assume that the luminance reduction by the use of ND filters does not simply generate a delay but instead result in a low-pass filtering of the input51, then, an induced slowing down of one eye image could also induce an interocular velocity difference which could provide an alternate explanation for the classic Pulfrich phenomenon. Whatever the explanation, we have shown for the first time that contrast as well as luminance imbalances can drive illusory percepts of depth.
Methods
Stimuli
The stimulus was a structure-from-motion defined rotating cylinder of 18° width and 12° height, consisting of 200 Gabor patches oscillating horizontally at a sinusoidal angular speed of 18°/s for a duration of 800 ms (Fig. 1a, supplementary movies). The stimulus was presented dichoptically. The interocular phase of the oscillation was consistent between all Gabor patches trajectories and was varied to generate strong to ambiguous percepts of a cylinder rotating in depth (Fig. 1b)12, 30. Each Gabor patch was 0.15° sigma, 2.85 c/d spatial frequency with a random phase. Stimuli and experimental procedures were programmed with Matlab R2015a (© the MathWorks) using the Psychophysics toolbox52,53,54. Experiments were run on an Apple MacPro computer with a Nvidia GeForce 8800 GT graphics card, running on Linux Mint operating system. The stimuli were presented on a wide 23” 3D-Ready LED monitor ViewSonic V3D231, gamma corrected with a mean luminance of 100 cd.m−2 at a resolution of 1920 × 1080 px and a refresh rate of 60 Hz in interleaved line stereo mode. The subject viewed the stimuli at a viewing distance of 90 cm, in a dim-lit room, with passive polarized 3D glasses which had the effect of reducing the luminance to about 40%, measured with a photometer and a crosstalk of 1%55.
Procedures
10 subjects (4 males, mean age 26.8 ± 6.5 yo, one author: S1, their monocular contrast sensitivity are reported in Supplementary Figure 2) with normal stereo vision (all thresholds below 100 seconds, randot test) participated in this experiment. Their task was to report whether they saw the cylinder rotating clockwise or anticlockwise as a function of the interocular phase in a block design paradigm. In one block, one contrast or one luminance was tested with 10 repetitions. Each block was repeated 2 times in a counterbalanced way. Figure 2a depicts the psychometric function of one subject reporting a clockwise perception as a function of the interocular phase difference for different luminance or contrast conditions. Luminance modulations were generated by placing a ND filter in front of one eye (negative values indicate the filter was in front of the left eye, positive values in front of the right eye). Contrast (expressed as Michelson’s) was modulated on-screen (negative values, contrast decreased in the left eye image, positive values contrast decreased in the right eye image). This research has been approved by the Ethics Review Board of the McGill University Health Center and was performed in accordance with the ethical standards laid down in the Code of Ethics of the World Medical Association (Declaration of Helsinki). Informed consent was obtained from all subjects.
Data analysis
The data was analyzed with Matlab R2014a (© the MathWorks). The psychometric functions were fitted with a logistic function forced between 0 and 1. The estimated midpoint of the logistic function defines the point of subjective equality (PSE), the point at which the perception is 0.5 clockwise and 0.5 anticlockwise. The estimated point of subjective equality is then reported as a function of the interocular luminance difference and fitted by a linear regression in a fashion similar to Carkeet et al.34.
References
Julesz, B. & White, B. Short term visual memory and the Pulfrich phenomenon. Nature 222(5194), 639–641 (1969).
Anzai, A., Ohzawa, I. & Freeman, R. D. Joint-encoding of motion and depth by visual cortical neurons: neural basis of the Pulfrich effect. Nat Neurosci 4(5), 513–518 (2001).
Pulfrich, C. Die Stereoskopie im Dienste der isochromen und hete-rochromen Photometrie. Naturwissenschaften 10, 553–564 (1922).
Wilson, J. A. & Anstis, S. M. Visual Delay as a Function of Luminance. The American Journal of Psychology 82(3), 350 (1969).
Raz, D. et al. The effect of contrast and luminance on mfERG responses in a monkey model of glaucoma. Invest Ophthalmol Vis Sci 43(6), 2027–2035 (2002).
Geisler, W. S., Albrecht, D. G. & Crane, A. M. Responses of neurons in primary visual cortex to transient changes in local contrast and luminance. J Neurosci 27(19), 5063–5067 (2007).
Heravian-Shandiz, J., Douthwaite, W. A. & Jenkins, T. C. Binocular interaction with neutral density filters as measured by the visual evoked response. Optom Vis Sci 68(10), 801–806 (1991).
Katsumi, O., Tanino, T. & Hirose, T. Objective evaluation of binocular function using the pattern reversal visual evoked response. II. Effect of mean luminosity. Acta Ophthalmol (Copenh) 64(2), 199–205 (1986).
Bradley, D. C., Qian, N. & Andersen, R. A. Integration of motion and stereopsis in middle temporal cortical area of macaques. Nature 373(6515), 609–611 (1995).
DeAngelis, G. C. & Newsome, W. T. Organization of disparity-selective neurons in macaque area MT. J Neurosci 19(4), 1398–1415 (1999).
Sanada, T. M. & DeAngelis, G. C. Neural Representation of Motion-In-Depth in Area MT. Journal of Neuroscience 34(47), 15508–15521 (2014).
Dodd, J. V., Krug, K., Cumming, B. G. & Parker, A. J. Perceptually bistable three-dimensional figures evoke high choice probabilities in cortical area MT. J Neurosci 21(13), 4809–4821 (2001).
Czuba, T. B., Huk, A. C., Cormack, L. K. & Kohn, A. Area MT Encodes Three-Dimensional Motion. Journal of Neuroscience 34(47), 15522–15533 (2014).
Rokers, B., Cormack, L. K. & Huk, A. C. Disparity- and velocity-based signals for three-dimensional motion perception in human MT+. Nat Neurosci 12(8), 1050–1055 (2009).
Pack, C. C., Born, R. T. & Livingstone, M. S. Two-dimensional substructure of stereo and motion interactions in macaque visual cortex. Neuron 37(3), 525–535 (2003).
Carney, T., Paradiso, M. A. & Freeman, R. D. A physiological correlate of the Pulfrich effect in cortical neurons of the cat. Vision Res 29(2), 155–165 (1989).
Qian, N. & Andersen, R. A. A physiological model for motion-stereo integration and a unified explanation of Pulfrich-like phenomena. Vision Res 37(12), 1683–1698 (1997).
Shapley, R. M. & Victor, J. D. The effect of contrast on the transfer properties of cat retinal ganglion cells. J Physiol 285, 275–298 (1978).
Mante, V., Frazor, R. A., Bonin, V., Geisler, W. S. & Carandini, M. Independence of luminance and contrast in natural scenes and in the early visual system. Nat Neurosci 8(12), 1690–1697 (2005).
Albrecht, D. G. Visual cortex neurons in monkey and cat: effect of contrast on the spatial and temporal phase transfer functions. Vis Neurosci 12(6), 1191–1210 (1995).
Lui, L. L., Bourne, J. A. & Rosa, M. G. P. Relationship between size summation properties, contrast sensitivity and response latency in the dorsomedial and middle temporal areas of the primate extrastriate cortex. PLoS One 8(6), e68276 (2013).
Jones, R. & Keck, M. J. Visual evoked response as a function of grating spatial frequency. Invest Ophthalmol Vis Sci 17(7), 652–659 (1978).
Barthélemy, F. V., Vanzetta, I. & Masson, G. S. Behavioral receptive field for ocular following in humans: dynamics of spatial summation and center-surround interactions. J Neurophysiol 95(6), 3712–3726 (2006).
Yehezkel, O., Ding, J., Sterkin, A., Polat, U. & Levi, D. M. Binocular combination of stimulus orientation Royal Society Open. Science 3(11), 160534 (2016).
Ding, J. & Sperling, G. A gain-control theory of binocular combination. Proc Natl Acad Sci USA 103(4), 1141–1146 (2006).
Ding, J. & Sperling, G. J Binocular Combination: Measurements and a Model Cambridge University Press, L. H. &. M. R. M. (Ed.) (Ch. 15), 257–305 (2007).
Ding, J., Klein, S. A. & Levi, D. M. Binocular combination of phase and contrast explained by a gain-control and gain-enhancement model. J Vis. 13(2), 1–37 (2013).
Diamond, A. L. Simultaneous brightness contrast and the Pulfrich phenomenon. J Opt Soc Am, 48(12), 887–890 (1958).
Kitaoka, A. & Ashida, H. A variant of the anomalous motion illusion based upon contrast and visual latency. Perception 36(7), 1019–1035 (2007).
Treue, S., Husain, M. & Andersen, R. A. Human perception of structure from motion. Vision Res 31(1), 59–75 (1991).
Wallach, H. & O’Connell, D. N. The kinetic depth effect. Journal of Experimental Psychology 45(4), 205–217 (1953).
Braunstein, M. L., Sauer, C. W., Feria, C. S. & Andersen, G. J. Perceived Internal Depth in Rotating and Translating Objects. Perception 31(8), 943–954 (2002).
Tredici, T. D. & von Noorden, G. K. The Pulfrich effect in anisometropic amblyopia and strabismus. Am J Ophthalmol 98(4), 499–503 (1984).
Carkeet, A., Wildsoet, C. F. & Wood, J. M. Inter-ocular temporal asynchrony (IOTA): psychophysical measurement of inter-ocular asymmetry of visual latency. Ophthalmic Physiol Opt 17(3), 255–262 (1997).
Morgan, M. Stereoillusion based on visual persistence. Nature 256(5519), 639–640 (1975).
Morgan, M. J. & Castet, E. Stereoscopic depth perception at high velocities. Nature 378(6555), 380–383 (1995).
Read, J. C. A. & Cumming, B. G. The stroboscopic Pulfrich effect is not evidence for the joint encoding of motion and depth. J Vis 5(5), 417–434 (2005).
Reynaud, A., Tang, Y., Zhou, Y. & Hess, R. F. A normative framework for the study of second-order sensitivity in vision. J Vis. 14(9), 3, 1–16 (2014).
van Rossum, M. C. W., van der Meer, M. A. A., Xiao, D. & Oram, M. W. Adaptive Integration in the Visual Cortex by Depressing Recurrent Cortical Circuits. Neural Computation 20(7), 1847–1872 (2008).
Oram, M. W. Contrast induced changes in response latency depend on stimulus specificity. Journal of Physiology-Paris 104(3–4), 167–175 (2010).
Meirovithz, E. et al. Population Response to Contextual Influences in the Primary Visual Cortex. Cereb Cortex 20(6), 1293–304 (2010).
Reynaud, A., Masson, G. S. & Chavane, F. Dynamics of local input normalization result from balanced short- and long-range intracortical interactions in area v1. J Neurosci 32(36), 12558–12569 (2012).
Solomon, J. A. & Morgan, M. J. Low-contrast translating edges appear to lag behind high-contrast ones. Investigative Ophthalmology and Visual Science 37, S749 (1996).
Bonneh, Y. S., Adini, Y. & Polat, U. Contrast sensitivity revealed by microsaccades. Journal of Vision 15(9), 11 (2015).
Regan, D. Binocular correlates of the direction of motion in depth. Vision Research 33(16), 2359–2360 (1993).
Cumming, B. G. & Parker, A. J. Binocular mechanisms for detecting motion-in-depth. Vision Res 34(4), 483–495 (1994).
Harris, J. M., Nefs, H. T. & Grafton, C. E. Binocular vision and motion-in-depth. Spat Vis 21(6), 531–547 (2008).
Brooks, K. Stereomotion speed perception is contrast dependent Perception, 30(6), 725–731 (2001).
Thompson, P. Perceived rate of movement depends on contrast. Vision Research 22(3), 377–380 (1982).
Campbell, F. & Maffei, L. The influence of spatial frequency and contrast on the perception of moving patterns. Vision Research 21(5), 713–721 (1981).
Reynaud, A., Zhou, J. & Hess, R. F. Stereopsis and mean luminance. J Vis. 13(11), 1, 1–11 (2013).
Brainard, D. H. (1997) The Psychophysics Toolbox. Spat Vis. 10(4), 433–436 (2013).
Kleiner, M., Brainard, D. & Pelli, D. What’s new in Psychtoolbox-3? (2007).
Pelli, D. G. The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat Vis 10(4), 437–442 (1997).
Spiegel, D. P., Baldwin, A. S. & Hess, R. F. Ocular dominance plasticity: inhibitory interactions and contrast equivalence. Scientific Reports 7, 39913 (2017).
Acknowledgements
We thank our participants to this study. This work was supported by a Canadian Institutes of Health Research (#108-18) and a Natural Sciences and Engineering Research Council of Canada grant (#46528) to RFH.
Author information
Authors and Affiliations
Contributions
A.R. and R.F.H. designed the study and wrote the manuscript. A.R. performed the experiments and analyzed the data.
Corresponding author
Ethics declarations
Competing Interests
The authors declare that they have no competing interests.
Additional information
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Reynaud, A., Hess, R.F. Interocular contrast difference drives illusory 3D percept. Sci Rep 7, 5587 (2017). https://doi.org/10.1038/s41598-017-06151-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-017-06151-w
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.