Temporal channels and disparity representations in stereoscopic depth perception.

Stereoscopic depth perception is supported by a combination of correlation-based and match-based representations of binocular disparity. It also relies on both transient and sustained temporal channels of the visual system. Previous studies suggest that the relative contribution of the correlation-based representation (over the match-based representation) and the transient channel (over the sustained channel) to depth perception increases with the disparity magnitude. The mechanisms of the correlation-based and match-based representations may receive preferential inputs from the transient and sustained channels, respectively. We examined near/far discrimination by observers using random-dot stereograms refreshed at various rates. The relative contribution of the two representations was inferred by changing the fraction of dots that were contrast reversed between the two eyes. Both representations contributed to depth discrimination over the tested range of refresh rates. As the rate increased, the correlation-based representation increased its contribution to near/far discrimination. Another experiment revealed that the match-based representation was constructed by exploiting the variability in correlation-based disparity signals. Thus, the relative weight of the transient over sustained channel differs between the two representations. The correlation-based representation dominates depth perception with dynamic inputs. The match-based representation, which may be a nonlinear refinement of the correlation-based representation, exerts more influence on depth perception with slower inputs.

[1]  L. Glass Moiré Effect from Random Dots , 1969, Nature.

[2]  D Marr,et al.  A computational theory of human stereo vision. , 1979, Proceedings of the Royal Society of London. Series B, Biological sciences.

[3]  Ichiro Fujita,et al.  Disparity-energy signals in perceived stereoscopic depth. , 2008, Journal of vision.

[4]  L E Mays,et al.  Neurons in monkey parietal area LIP are tuned for eye-movement parameters in three-dimensional space. , 1995, Journal of neurophysiology.

[5]  Christopher W Tyler,et al.  Relative contributions of sustained and transient pathways to human stereoprocessing , 2000, Vision Research.

[6]  Takahiro Doi,et al.  Disparity-tuning characteristics of neuronal responses to dynamic random-dot stereograms in macaque visual area V4. , 2005, Journal of neurophysiology.

[7]  B. G. Cumming,et al.  Responses of primary visual cortical neurons to binocular disparity without depth perception , 1997, Nature.

[8]  P. O. Bishop,et al.  Spatial vision. , 1971, Annual review of psychology.

[9]  I. Fujita,et al.  Rejection of False Matches for Binocular Correspondence in Macaque Visual Cortical Area V4 , 2004, The Journal of Neuroscience.

[10]  F. A. Miles,et al.  Single-unit activity in cortical area MST associated with disparity-vergence eye movements: evidence for population coding. , 2001, Journal of neurophysiology.

[11]  G. DeAngelis,et al.  Cortical area MT and the perception of stereoscopic depth , 1998, Nature.

[12]  A. Dean The variability of discharge of simple cells in the cat striate cortex , 2004, Experimental Brain Research.

[13]  G. Orban,et al.  At Least at the Level of Inferior Temporal Cortex, the Stereo Correspondence Problem Is Solved , 2003, Neuron.

[14]  Mark Edwards,et al.  Spatial-frequency and contrast tuning of the transient-stereopsis system , 1998, Vision Research.

[15]  Jenny C. A. Read A Bayesian model of stereopsis depth and motion direction discrimination , 2002, Biological Cybernetics.

[16]  A. Leventhal,et al.  Signal timing across the macaque visual system. , 1998, Journal of neurophysiology.

[17]  E. Callaway,et al.  Parallel processing strategies of the primate visual system , 2009, Nature Reviews Neuroscience.

[18]  Bruce G Cumming,et al.  Mechanisms Underlying the Transformation of Disparity Signals from V1 to V2 in the Macaque , 2008, The Journal of Neuroscience.

[19]  Christopher W. Tyler,et al.  A stereoscopic view of visual processing streams , 1990, Vision Research.

[20]  Ichiro Fujita,et al.  Spatial frequency integration for binocular correspondence in macaque area V4. , 2008, Journal of neurophysiology.

[21]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[22]  H. Wagner,et al.  A threshold explains modulation of neural responses to opposite-contrast stereograms , 2001, Neuroreport.

[23]  G. Poggio,et al.  Mechanisms of static and dynamic stereopsis in foveal cortex of the rhesus monkey , 1981, The Journal of physiology.

[24]  David R. Pope,et al.  Extraction of depth from opposite-contrast stimuli: transient system can, sustained system can’t , 1999, Vision Research.

[25]  H. Sakata,et al.  Deficit of hand preshaping after muscimol injection in monkey parietal cortex , 1994, Neuroreport.

[26]  A. Parker,et al.  Range and mechanism of encoding of horizontal disparity in macaque V1. , 2002, Journal of neurophysiology.

[27]  Laurie M. Wilcox,et al.  The transient nature of 2nd-order stereopsis , 2008, Vision Research.

[28]  J. Movshon,et al.  A computational analysis of the relationship between neuronal and behavioral responses to visual motion , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  Gregory C DeAngelis,et al.  Macaque Middle Temporal Neurons Signal Depth in the Absence of Motion , 2003, The Journal of Neuroscience.

[30]  Laurie M. Wilcox,et al.  Scale selection for second-order (non-linear) stereopsis , 1997, Vision Research.

[31]  Bruce G Cumming,et al.  Sensors for impossible stimuli may solve the stereo correspondence problem , 2007, Nature Neuroscience.

[32]  G. DeAngelis,et al.  Spatiotemporal receptive field organization in the lateral geniculate nucleus of cats and kittens. , 1997, Journal of neurophysiology.

[33]  A. Parker,et al.  Stereoscopic Vision in the Absence of the Lateral Occipital Cortex , 2010, PloS one.

[34]  Richard A Eagle,et al.  Weighted directional energy model of human stereo correspondence , 2000, Vision Research.

[35]  S. McKee,et al.  The role of retinal correspondence in stereoscopic matching , 1988, Vision Research.

[36]  G. DeAngelis,et al.  Contribution of Area MT to Stereoscopic Depth Perception Choice-Related Response Modulations Reflect Task Strategy , 2004, Neuron.

[37]  B. Cumming,et al.  Suppressive Mechanisms in Monkey V1 Help to Solve the Stereo Correspondence Problem , 2011, The Journal of Neuroscience.

[38]  Mark Edwards,et al.  Depth aliasing by the transient-stereopsis system , 1999, Vision Research.

[39]  G. Poggio,et al.  Stereoscopic mechanisms in monkey visual cortex: binocular correlation and disparity selectivity , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[40]  Hirohisa Yaguchi,et al.  Stereo channels with different temporal frequency tunings , 2007, Vision Research.

[41]  Takahiro Doi,et al.  Neural Activity in Cortical Area V4 Underlies Fine Disparity Discrimination , 2012, The Journal of Neuroscience.

[42]  John H. R. Maunsell,et al.  Mixed parvocellular and magnocellular geniculate signals in visual area V4 , 1992, Nature.

[43]  A. Parker,et al.  Comparing perceptual signals of single V5/MT neurons in two binocular depth tasks. , 2004, Journal of neurophysiology.

[44]  T. Nealey,et al.  Magnocellular and parvocellular contributions to responses in the middle temporal visual area (MT) of the macaque monkey , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  F. A. Miles,et al.  Vergence eye movements in response to binocular disparity without depth perception , 1997, Nature.

[46]  M. Potter Meaning in visual search. , 1975, Science.

[47]  I. Ohzawa,et al.  Neural mechanisms for processing binocular information I. Simple cells. , 1999, Journal of neurophysiology.

[48]  A. Parker,et al.  Receptive Field Size in V1 Neurons Limits Acuity for Perceiving Disparity Modulation , 2004, The Journal of Neuroscience.

[49]  Bruce G. Cumming,et al.  Adaptation to Natural Binocular Disparities in Primate V1 Explained by a Generalized Energy Model , 2008, Neuron.

[50]  R. Pérez,et al.  Perception of Random Dot Interference Patterns , 1973, Nature.

[51]  Robert S. Allison,et al.  Coarse-fine dichotomies in human stereopsis , 2009, Vision Research.

[52]  Holly Bridge,et al.  Topographical representation of binocular depth in the human visual cortex using fMRI. , 2007, Journal of vision.

[53]  Richard A Eagle,et al.  Reversed stereo depth and motion direction with anti-correlated stimuli , 2000, Vision Research.

[54]  R. Shapley,et al.  Temporal-frequency selectivity in monkey visual cortex , 1996, Visual Neuroscience.

[55]  G. Poggio,et al.  Binocular interaction and depth sensitivity in striate and prestriate cortex of behaving rhesus monkey. , 1977, Journal of neurophysiology.

[56]  Frank Tong,et al.  Temporal limitations in object processing across the human ventral visual pathway. , 2007, Journal of neurophysiology.

[57]  A. Parker Binocular depth perception and the cerebral cortex , 2007, Nature Reviews Neuroscience.

[58]  Ning Qian,et al.  Physiological computation of binocular disparity , 1997, Vision Research.

[59]  Takahiro Doi,et al.  Matching and correlation computations in stereoscopic depth perception. , 2011, Journal of vision.

[60]  Mark Edwards,et al.  Orientation tuning of the transient-stereopsis system , 1999, Vision Research.

[61]  I. Ohzawa,et al.  Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. I. General characteristics and postnatal development. , 1993, Journal of neurophysiology.

[62]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[63]  Mark Edwards,et al.  First- and second-order processing in transient stereopsis , 2000, Vision Research.

[64]  Z. Kourtzi,et al.  Multivoxel Pattern Selectivity for Perceptually Relevant Binocular Disparities in the Human Brain , 2008, The Journal of Neuroscience.

[65]  David J. Heeger,et al.  Spatiotemporal mechanisms for detecting and identifying image features in human vision , 2002, Nature Neuroscience.

[66]  Peter Janssen,et al.  Selectivity for three-dimensional contours and surfaces in the anterior intraparietal area. , 2012, Journal of neurophysiology.

[67]  I. Ohzawa,et al.  Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.