Stereo and motion parallax cues in human 3D vision: can they vanish without a trace?

In an immersive virtual reality environment, subjects fail to notice when a scene expands or contracts around them, despite correct and consistent information from binocular stereopsis and motion parallax, resulting in gross failures of size constancy (A. Glennerster, L. Tcheang, S. J. Gilson, A. W. Fitzgibbon, & A. J. Parker, 2006). We determined whether the integration of stereopsis/motion parallax cues with texture-based cues could be modified through feedback. Subjects compared the size of two objects, each visible when the room was of a different size. As the subject walked, the room expanded or contracted, although subjects failed to notice any change. Subjects were given feedback about the accuracy of their size judgments, where the "correct" size setting was defined either by texture-based cues or (in a separate experiment) by stereo/motion parallax cues. Because of feedback, observers were able to adjust responses such that fewer errors were made. For texture-based feedback, the pattern of responses was consistent with observers weighting texture cues more heavily. However, for stereo/motion parallax feedback, performance in many conditions became worse such that, paradoxically, biases moved away from the point reinforced by the feedback. This can be explained by assuming that subjects remap the relationship between stereo/motion parallax cues and perceived size or that they develop strategies to change their criterion for a size match on different trials. In either case, subjects appear not to have direct access to stereo/motion parallax cues.

[1]  J. Saunders,et al.  Do humans optimally integrate stereo and texture information for judgments of surface slant? , 2003, Vision Research.

[2]  Wendy J. Adams,et al.  Adaptation to three-dimensional distortions in human vision , 2001, Nature Neuroscience.

[3]  A. GLENNERSTER,et al.  Stereoscopic Depth Constancy Depends on the Subject's Task , 1996, Vision Research.

[4]  Taylor Mm Figural after-effects: a psychophysical theory of the displacement effect. , 1962 .

[5]  S. McKee,et al.  The imprecision of stereopsis , 1990, Vision Research.

[6]  David J. Fleet,et al.  Human cortical activity correlates with stereoscopic depth perception. , 2001, Journal of neurophysiology.

[7]  H. Levitt Transformed up-down methods in psychoacoustics. , 1971, The Journal of the Acoustical Society of America.

[8]  James M. Hillis,et al.  Combining Sensory Information: Mandatory Fusion Within, but Not Between, Senses , 2002, Science.

[9]  Zijiang J. He,et al.  Distance determined by the angular declination below the horizon , 2001, Nature.

[10]  H. Akaike A new look at the statistical model identification , 1974 .

[11]  Francescaromana Maradei,et al.  Measurement and Modeling , 2008 .

[12]  A. Parker,et al.  Integration of depth modules: Stereopsis and texture , 1993, Vision Research.

[13]  D. Ballard,et al.  Fast Temporal Dynamics of Visual Cue Integration , 2000, Perception.

[14]  Yukie Saito,et al.  Integration of Stereopsis and Motion Shape Cues , 1993 .

[15]  J. Todd,et al.  Systematic distortion of perceived three-dimensional structure from motion and binocular stereopsis. , 1995, Journal of experimental psychology. Human perception and performance.

[16]  M. Landy,et al.  Measurement and modeling of depth cue combination: in defense of weak fusion , 1995, Vision Research.

[17]  J. Lewis,et al.  Probit Analysis (3rd ed). , 1972 .

[18]  T. Cornsweet,et al.  The staircrase-method in psychophysics. , 1962, The American journal of psychology.

[19]  James T. Todd,et al.  Systematic distortion of perceived three-dimensional structure from motion and binocular stereopsis. , 1995 .

[20]  R. Jacobs What determines visual cue reliability? , 2002, Trends in Cognitive Sciences.

[21]  Andrew Glennerster,et al.  The task-dependent use of binocular disparity and motion parallax information , 2000, Vision Research.

[22]  B. T. Backus,et al.  Perceptual Metamers in Stereoscopic Vision , 2001, NIPS.

[23]  Figural after-effects: a psychophysical theory of the displacement effect. , 1962, Canadian journal of psychology.

[24]  M. Landy,et al.  A perturbation analysis of depth perception from combinations of texture and motion cues , 1993, Vision Research.

[25]  R. Jacobs,et al.  Experience-dependent visual cue integration based on consistencies between visual and haptic percepts , 2001, Vision Research.

[26]  John P. Frisby,et al.  Interaction of stereo, texture and outline cues in the shape perception of three-dimensional ridges , 1993, Vision Research.

[27]  A. Fitzgibbon,et al.  Humans Ignore Motion and Stereo Cues in Favor of a Fictional Stable World , 2006, Current Biology.

[28]  W Richards,et al.  Structure from stereo and motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.