A stimulus artefact undermines the evidence for independent ON and OFF channels in stereopsis

Early vision proceeds through distinct ON and OFF channels, which encode luminance increments and decrements respectively. It has been argued that these channels also contribute separately to stereoscopic vision. This is based on the fact that observers perform better on a noisy disparity discrimination task when the stimulus is a random-dot pattern consisting of equal numbers of black and white dots (a “mixed-polarity stimulus”, argued to activate both ON and OFF stereo channels), than when it consists of all-white or all-black dots (“same-polarity”, argued to activate only one). However, it is not clear how this theory can be reconciled with our current understanding of disparity encoding. Recently, a binocular convolutional neural network was able to replicate the mixed-polarity advantage shown by human observers, even though it was based on linear filters and contained no mechanisms which would respond separately to black or white dots. Here, we show that the stimuli used in all these experiments contain a subtle artefact. The interocular correlation between left and right images is actually lower for the same-polarity stimuli than for mixed-polarity stimuli with the same amount of disparity noise applied to the dots. Since our current theories suggest stereopsis is based on a correlation-like computation in primary visual cortex, it is then unsurprising that performance was better for the mixed-polarity stimuli. We conclude that there is currently no evidence supporting separate ON and OFF channels in stereopsis.

[1]  A. Parker.  Binocular depth perception and the cerebral cortex , 2007, Nature Reviews Neuroscience.

[2]  J. Read,et al.  The place of human psychophysics in modern neuroscience , 2015, Neuroscience.

[3]  Takahiro Doi,et al.  Matching and correlation computations in stereoscopic depth perception. , 2011, Journal of vision.

[4]  Bruce Cumming,et al.  Disparity processing in primary visual cortex , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[5]  B. G. Cumming,et al.  Responses of primary visual cortical neurons to binocular disparity without depth perception , 1997, Nature.

[6]  A. Welchman,et al.  “What Not” Detectors Help the Brain See in Depth , 2017, Current Biology.

[7]  Shih-Cheng Yen,et al.  Responses of primary visual cortical neurons to natural movies in anesthetized cat , 2008, BMC Neuroscience.

[8]  Gregory C DeAngelis,et al.  Disparity Channels in Early Vision , 2007, The Journal of Neuroscience.

[9]  I. Ohzawa,et al.  Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.

[10]  Bruce G Cumming,et al.  Neurons in Striate Cortex Signal Disparity in Half-Matched Random-Dot Stereograms , 2016, The Journal of Neuroscience.

[11]  Bruce G Cumming,et al.  A simple model accounts for the response of disparity-tuned V1 neurons to anticorrelated images , 2002, Visual Neuroscience.

[12]  Ning Qian,et al.  Physiological computation of binocular disparity , 1997, Vision Research.

[13]  J. Read.  Early computational processing in binocular vision and depth perception. , 2005, Progress in biophysics and molecular biology.

[14]  Bruce G Cumming,et al.  Ocular dominance predicts neither strength nor class of disparity selectivity with random-dot stimuli in primate V1. , 2004, Journal of neurophysiology.

[15]  Karl R Gegenfurtner,et al.  Higher order color mechanisms: evidence from noise-masking experiments in cone contrast space. , 2013, Journal of vision.

[16]  Peter H. Schiller,et al.  Parallel information processing channels created in the retina , 2010, Proceedings of the National Academy of Sciences.

[17]  Ignacio Serrano-Pedraza,et al.  Independent mechanisms for bright and dark image features in a stereo correspondence task. , 2011, Journal of vision.

[18]  Peter H. Schiller,et al.  The ON and OFF channels of the visual system , 1992, Trends in Neurosciences.

[19]  Takahiro Doi,et al.  Temporal channels and disparity representations in stereoscopic depth perception. , 2013, Journal of vision.

[20]  Hao Sun,et al.  A new view of receptive field structure of midget ganglion cells , 2009 .

[21]  G. Rhodes,et al.  Sex-specific norms code face identity. , 2011, Journal of vision.

[22]  Jenny Read,et al.  Spatial Stereoresolution for Depth Corrugations May Be Set in Primary Visual Cortex , 2011, BMC Neuroscience.

[23]  Izumi Ohzawa,et al.  Mechanisms of stereoscopic vision: the disparity energy model , 1998, Current Opinion in Neurobiology.

[24]  G C DeAngelis,et al.  The physiology of stereopsis. , 2001, Annual review of neuroscience.

[25]  Takahiro Doi,et al.  Cross-matching: a modified cross-correlation underlying threshold energy model and match-based depth perception , 2014, Front. Comput. Neurosci..

[26]  Christopher W. Tyler,et al.  Binocular cross-correlation in time and space , 1978, Vision Research.

[27]  L. Cormack,et al.  Interocular correlation, luminance contrast and cyclopean processing , 1991, Vision Research.

[28]  Bruce G. Cumming,et al.  Visual Perception: Neural Networks for Stereopsis , 2017, Current Biology.

[29]  Bruce G. Cumming,et al.  A Single Mechanism Can Account for Human Perception of Depth in Mixed Correlation Random Dot Stereograms , 2016, PLoS Comput. Biol..

[30]  Martin S Banks,et al.  Limits of stereopsis explained by local cross-correlation. , 2009, Journal of vision.

[31]  Gopathy Purushothaman,et al.  The functional asymmetry of ON and OFF channels in the perception of contrast. , 2015, Journal of neurophysiology.