Toward a new theory of stereopsis.

Humans can obtain an unambiguous perception of depth and 3-dimensionality with 1 eye or when viewing a pictorial image of a 3-dimensional scene. However, the perception of depth when viewing a real scene with both eyes is qualitatively different: There is a vivid impression of tangible solid form and immersive negative space. This perceptual phenomenon, referred to as "stereopsis," has been among the central puzzles of perception since the time of da Vinci. After Wheatstone's invention of the stereoscope in 1838, stereopsis has conventionally been explained as a byproduct of binocular vision or visual parallax. However, this explanation is challenged by the observation that the impression of stereopsis can be induced in single pictures under monocular viewing. Here I propose an alternative hypothesis that stereopsis is a qualitative visual experience related to the perception of egocentric spatial scale. Specifically, the primary phenomenal characteristic of stereopsis (the impression of "real" separation in depth) is proposed to be linked to the precision with which egocentrically scaled depth (absolute depth) is derived. Since conscious awareness of this precision could help guide the planning of motor action, the hypothesis provides a functional account for the important secondary phenomenal characteristics associated with stereopsis: the impression of interactability and realness. By linking stereopsis to a generic perceptual attribute, rather than a specific cue, it provides a potentially more unified account of the variation of stereopsis in real scenes and pictures and a basis for understanding why we can perceive depth in pictures despite conflicting visual signals.

[1]  Edward H. Adelson,et al.  The perception of shading and reflectance , 1996 .

[2]  Adolf von Hildebrand,et al.  The problem of form in painting and sculpture , 1907 .

[3]  A. Fitzgibbon,et al.  Pictorial relief - Discussion , 1998 .

[4]  J. Philbeck,et al.  Comparison of two indicators of perceived egocentric distance under full-cue and reduced-cue conditions , 1997 .

[5]  A. GLENNERSTER,et al.  Stereoscopic Depth Constancy Depends on the Subject's Task , 1996, Vision Research.

[6]  James M. Hillis,et al.  Combining Sensory Information: Mandatory Fusion Within, but Not Between, Senses , 2002, Science.

[7]  J. Koenderink,et al.  Depth Relief , 1995, Perception.

[8]  Frank Scalambrino.  Perception beyond Inference , 2014 .

[9]  D. Chalmers.  Philosophy of Mind: Classical and Contemporary Readings , 2021 .

[10]  S. Freguia.  Researches in Binocular Vision. , 1950 .

[11]  Robert D. McIntosh,et al.  Matching boxes: Familiar size influences action programming , 2008, Neuropsychologia.

[12]  Bin Wang,et al.  Depth-of-focus of the human eye in the near retinal periphery , 2003, Vision Research.

[13]  John M. Kennedy,et al.  Optics Painting and Photography , 1970 .

[14]  H H Bülthoff,et al.  Integration of depth modules: stereo and shading. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[15]  Rainer Mausfeld,et al.  Conjoint representations and the mental capacity for multiple simultaneous perspectives , 2003 .

[16]  Jack M. Loomis,et al.  Visual perception of egocentric distance in real and virtual environments. , 2003 .

[17]  J. Loomis,et al.  Visual space perception and visually directed action. , 1992, Journal of experimental psychology. Human perception and performance.

[18]  Elia Vecellio,et al.  Binocular depth discrimination and estimation beyond interaction space. , 2009, Journal of vision.

[19]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[20]  Massimiliano Di Luca,et al.  Inconsistency of perceived 3D shape , 2010, Vision Research.

[21]  Liliana Albertazzi,et al.  Experimental Phenomenology: An Introduction , 2013 .

[22]  James F. O'Brien,et al.  Using blur to affect perceived distance and size , 2010, TOGS.

[23]  W. Epstein,et al.  The current status of the size-distance hypotheses. , 1961, Psychological bulletin.

[24]  G E Legge,et al.  Pictorial depth cues: a new slant. , 1995, Journal of the Optical Society of America. A, Optics, image science, and vision.

[25]  M F Bradshaw,et al.  Vertical disparities, differential perspective and binocular stereopsis , 1993, Nature.

[26]  Fulvio Domini,et al.  Stereo and motion information are not independently processed by the visual system , 2006, Vision Research.

[27]  Harold Schlosberg,et al.  Stereoscopic Depth from Single Pictures , 1941 .

[28]  D. McCready,et al.  Size-distance perception and accommodation-convergence micropsia--a critique. , 1965, Vision research.

[29]  W. D. Craft,et al.  Foundations of spatial vision: from retinal images to perceived shapes. , 2000, Psychological review.

[30]  Leslie G. Ungerleider.  Two cortical visual systems , 1982 .

[31]  Fulvio Domini,et al.  Do we perceive a flattened world on the monitor screen? , 2011, Acta psychologica.

[32]  J. Aloimonos,et al.  On the kinetic depth effect , 1989, Biological Cybernetics.

[33]  P. Hibbard.  Can appearance be so deceptive? Representationalism and binocular vision. , 2008, Spatial vision.

[34]  Erik Blaser,et al.  Retinal blur and the perception of egocentric distance. , 2010, Journal of vision.

[35]  Equidistance effects in visual fields. , 1969, The American journal of psychology.

[36]  P. Grobstein.  Analysis of Visual Behavior, David J. Ingle, Melvyn A. Goodale, Richard J.W. Mansfield (Eds.). MIT press, Cambridge, MA and London (1982), 834 , 1983 .

[37]  B. Rogers,et al.  Similarities between motion parallax and stereopsis in human depth perception , 1982, Vision Research.

[38]  M. Mon-Williams,et al.  The size-distance paradox is a cognitive phenomenon , 1999, Experimental Brain Research.

[39]  Dhanraj Vishwanath.  Is focal blur an absolute cue to depth , 2010 .

[40]  Johannes Burge,et al.  Ordinal configural cues combine with metric disparity in depth perception. , 2005, Journal of vision.

[41]  J. Philbeck,et al.  Dissociation between location and shape in visual space. , 2002, Journal of experimental psychology. Human perception and performance.

[42]  A. Reinhardt-Rutland,et al.  The Framing Effect with Rectangular and Trapezoidal Surfaces: Actual and Pictorial Surface Slant, Frame Orientation, and Viewing Condition , 1999, Perception.

[43]  Dhanraj Vishwanath,et al.  Seeing in 3-D With Just One Eye , 2013, Psychology Science.

[44]  Alfred H. Holway,et al.  Determinants of Apparent Visual Size with Distance Variant , 1941 .

[45]  George Mather,et al.  Image blur as a pictorial depth cue , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[46]  Zijiang J. He,et al.  A distance judgment function based on space perception mechanisms: revisiting Gilinsky's (1951) equation. , 2007, Psychological review.

[47]  L. Stark,et al.  Binocular eye movements during accommodative vergence , 1978, Vision Research.

[48]  M. Ernst,et al.  Focus cues affect perceived depth. , 2005, Journal of vision.

[49]  K J Ciuffreda,et al.  Accommodation and Apparent Distance , 1988, Perception.

[50]  B Rogers,et al.  Motion Parallax as an Independent Cue for Depth Perception , 1979, Perception.

[51]  G. Butterworth,et al.  Michotte's experimental phenomenology of perception , 1994 .

[52]  Dhanraj Vishwanath,et al.  The Epistemological Status of Vision and its Implications for Design , 2005 .

[53]  J. M. Foley.  Binocular distance perception. , 1980, Psychological review.

[54]  Zijiang J. He,et al.  Distance determined by the angular declination below the horizon , 2001, Nature.

[55]  M. Mon-Williams,et al.  Some Recent Studies on the Extraretinal Contribution to Distance Perception , 1999, Perception.

[56]  Y Trotter,et al.  Distance Perception within near Visual Space , 2001, Perception.

[57]  Fulvio Domini,et al.  The intrinsic constraint model and Fechnerian sensory scaling. , 2009, Journal of vision.

[58]  J T Todd,et al.  Ambiguity and the ‘Mental Eye’ in Pictorial Relief , 2001, Perception.

[59]  James J. Clark,et al.  Data Fusion for Sensory Information Processing Systems , 1990 .

[60]  S. Gilson,et al.  A Demonstration of ‘Broken’ Visual Space , 2012, PloS one.

[61]  B. Anderson.  Depth perception , 2008 .

[62]  W C Gogel,et al.  Eye Fixation and Attention as Modifiers of Perceived Distance , 1977, Perceptual and motor skills.

[63]  Walter C. Gogel,et al.  Familiar size and the theory of off-sized perceptions , 1987, Perception & psychophysics.

[64]  Heinrich H. Bülthoff,et al.  Integration of Depth Modules , 1990 .

[65]  John M Foley,et al.  Effect of Distance Information and Range on Two Indices of Visually Perceived Distance , 1977, Perception.

[66]  Paul B. Hibbard,et al.  Quality in depth perception: the plastic effect , 2010 .

[67]  E M Eaton.  THE VISUAL PERCEPTION OF SOLID FORM , 1919, The British journal of ophthalmology.

[68]  M. Landy,et al.  Measurement and modeling of depth cue combination: in defense of weak fusion , 1995, Vision Research.

[69]  W C Gogel,et al.  The Effect of Object Familiarity on the Perception of Size and Distance , 1969, The Quarterly journal of experimental psychology.

[70]  Charles Wheatstone.  On some remarkable and hitherto unobserved phenomena of binocular vision. , 1962 .

[71]  C. A. Burbeck,et al.  Occlusion edge blur: a cue to relative visual depth. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[72]  Jan J. Koenderink,et al.  On the Affine Structure of Perceptual Space , 2001, Psychological science.

[73]  Marius Hans Erik Tscherning,et al.  Physiologic Optics: Dioptrics of the Eye, Functions of the Retina, Ocular Movements and Binocular Vision , 2010 .

[74]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[75]  W C Gogel,et al.  A theory of phenomenal geometry and its applications , 1990, Perception & psychophysics.

[76]  Fulvio Domini,et al.  Disparity and Shading Cues Cooperate for Surface Interpolation , 2006, Perception.

[77]  W. Epstein,et al.  Perceived depth as a function of relative height under three background conditions. , 1966, Journal of experimental psychology.

[78]  Zijiang J. He,et al.  Perceiving distance accurately by a directional process of integrating ground information , 2004, Nature.

[79]  M. Goodale,et al.  Two visual systems re-viewed , 2008, Neuropsychologia.

[80]  Pascal Mamassian,et al.  Bayesian combination of ambiguous shape cues. , 2004, Journal of vision.

[81]  E. Debski,et al.  Fixing my gaze: A scientist’s journey into seeing in three dimensions , 2009 .

[82]  H. Ono,et al.  Depth perception as a function of motion parallax and absolute-distance information. , 1986, Journal of experimental psychology. Human perception and performance.

[83]  Hans Wallach,et al.  Familiar size and linear perspective as distance cues in stereoscopic depth constancy , 1980 .

[84]  J Predebon,et al.  The Familiar-Size Cue to Distance and Stereoscopic Depth Perception , 1993, Perception.

[85]  James M. Hillis,et al.  Slant from texture and disparity cues: optimal cue combination. , 2004, Journal of vision.

[86]  Walter C. Gogel,et al.  The validity of the size-distance invariance hypothesis with cue reduction , 1971 .

[87]  Ian P. Howard,et al.  Seeing in Depth , 2008 .

[88]  H. Barlow.  Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[89]  D Buckley,et al.  Integration of Stereo, Texture, and Outline Cues during Pinhole Viewing of Real Ridge-Shaped Objects and Stereograms of Ridges , 1995, Perception.

[90]  Ian P. Howard,et al.  Binocular Vision and Stereopsis , 1996 .

[91]  H. Ehrsson.  The Experimental Induction of Out-of-Body Experiences , 2007, Science.

[92]  W. D. Wright.  Optics Painting and Photography , 1971 .

[93]  Julie M. Harris,et al.  Stereoscopic perception of real depths at large distances. , 2010, Journal of vision.

[94]  W C GOGEL,et al.  The visual perception of size and distance. , 1962, [Report]. Civil Aeromedical Research Institute.

[95]  L. Kaufman,et al.  The moon illusion. , 1962, Scientific American.

[96]  L. Albertazzi,et al.  Perception beyond inference : the information content of visual processes , 2010 .

[97]  H. von Helmholtz,et al.  Helmholtz's treatise on physiological optics, Vol. 1, Trans. from the 3rd German ed. , 1924 .

[98]  Walter C. Gogel,et al.  Absolute motion parallax and the specific distance tendency , 1973 .

[99]  Looking into Pictures , 2003 .

[100]  J J Koenderink,et al.  On So-Called Paradoxical Monocular Stereoscopy , 1994, Perception.

[101]  L. Albertazzi.  Visual quality: Drawing on canvas , 2006 .

[102]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[103]  Jan J. Koenderink,et al.  The combined influence of binocular disparity and shading on pictorial shape , 2001, Perception & psychophysics.

[104]  J. Philbeck,et al.  Is the anisotropy of perceived 3-D shape invariant across scale? , 1999, Perception & psychophysics.

[105]  Michael W. Haas,et al.  Virtual and Adaptive Environments: Applications, Implications, and Human Performance Issues , 2003 .

[106]  D R Proffitt,et al.  Stereokinetic effect and its relation to the kinetic depth effect. , 1992, Journal of experimental psychology. Human perception and performance.

[107]  Jan J. Koenderink,et al.  Pictorial relief , 2019, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[108]  W. Metzger,et al.  Psychologie : die Entwicklung ihrer Grundannahmen seit der Einführung des Experiments , 1941 .

[109]  M. Holly.  The psychology of perspective and renaissance art , 1989 .

[110]  Hans Wallach,et al.  Slope of regard as a distance cue , 1982, Perception & psychophysics.

[111]  M. Landy,et al.  A perturbation analysis of depth perception from combinations of texture and motion cues , 1993, Vision Research.

[112]  I. Howard,et al.  Seeing in depth, Vol. 2: Depth perception. , 2002 .

[113]  John P. Frisby,et al.  Interaction of stereo, texture and outline cues in the shape perception of three-dimensional ridges , 1993, Vision Research.

[114]  P C SMITH,et al.  Ball throwing responses to photographically portrayed targets. , 1961, Journal of experimental psychology.

[115]  C. Blakemore.  The range and scope of binocular depth discrimination in man , 1970, The Journal of physiology.

[116]  Jeffrey A Saunders,et al.  The accuracy and reliability of perceived depth from linear perspective as a function of image size. , 2010, Journal of vision.

[117]  D W Eby,et al.  The Perceptual Flattening of Three-Dimensional Scenes Enclosed by a Frame , 1995, Perception.

[118]  H. Ono,et al.  Leonardo da Vinci's Struggles with Representations of Reality , 2001, Leonardo.

[119]  H. Hecht,et al.  Looking into pictures : an interdisciplinary approach to pictorial space , 2003 .

[120]  Stefan Edlund,et al.  Perceptual distance and the constancy of size and stereoscopic depth. , 2006, Spatial vision.