Linear and non-linear mechanisms in the perception of stereoscopic slant and transparency.

This thesis explored the role of contrast disparities in stereopsis, and the nature of the encoding of surface slant from stereoscopic cues. Contrast disparities may be defined as interocular differences in the position of image regions corresponding in terms of image contrast, rather than luminance. It was found that, for simple plaid stimuli, stereoscopic slant thresholds could be predicted from disparities in the plaid's components. Further, the perceived slant of grating and plaid stimuli was found to be underestimated, with the degree of underestimation for plaids depending on the orientation of their component gratings. These results may be explained in terms of the orientation and spatial frequency disparities in the Fourier components of the stimuli, and are consistent with the notion that orientation disparities provide the primary cue to stereoscopic slant (Rogers and Graham, 1983). For plaids with orthogonal components, differing in contrast and spatial frequency, stereoscopic transparency was observed. Transparency was also observed in stimuli for which depth was defined by contrast modulation disparities. Transparency was only perceived for crossed disparities of the contrast modulation, such that the modulation appeared to lie in front of its carrier. This asymmetry was not evident if additional luminance disparities were introduced to the image. These results support the view that stereopsis has access to independent, linear and nonlinear channels (Hess and Wilcox, 1994). However, it was found that adaptation to the carrier of a contrast modulated stimulus increased the minimum contrast at which contrast disparities could be detected, suggesting that significant nonlinearities in stereopsis are preceded by a stage of linear filtering. These results were explained using a model in which luminance and contrast disparities are processed by independent linear and nonlinear mechanisms,s haring a common linear filtering stage early in processing. A ck n ow led gem en ts I would like to thank my supervisor, Keith Langley, for his help, advice and support throughout the thesis. Oliver Braddick and David Fleet also provided many helpful comments and ideas. I am grateful to many others at UCL for their encouragement and support. I would particularly like to thank Colin Clifford, Tom Hartley, Stevie Sackin, Peter Howell, Alan Johnston, Mark Gardner, Nico Preston, John Draper, Kate Bradford, and the Psychology Allstars . I would also like to thank David Green and George Houghton, for interesting me in Psychology as an undergraduate. Finally, I would like to thank Isabel, Jo, Paul(s), Carol, Ben, Mikie, Arshad, Garreth, Helen and the Loughborough posse for their friendship throughout. This thesis is for my parents.

[1]  Keith Langley,et al.  A MODEL FOR COHERENT AND MULTIPLICATIVELY TRANSPARENT PLAIDS , 1995 .

[2]  D. P. Andrews,et al.  APE: Adaptive probit estimation of psychometric functions , 1981 .

[3]  C. Tyler,et al.  Depth from spatial frequency difference: An old kind of stereopsis? , 1979, Vision Research.

[4]  Brian J. Rogers,et al.  The Perception and Representation of Depth and Slant in Stereoscopic Surfaces , 1992 .

[5]  D. Weinshall Seeing “ghost” planes in stereo vision , 1991, Vision Research.

[6]  B Gillam,et al.  Evidence for disparity change as the primary stimulus for stereoscopic processing , 1984, Perception & psychophysics.

[7]  I. Howard,et al.  Relative shear disparities and the perception of surface inclination , 1994, Vision Research.

[8]  J. Pokorny Foundations of Cyclopean Perception , 1972 .

[9]  Christopher W. Tyler,et al.  Analysis of stereothresholds for stimuli below 2.5 c/deg , 1994, Vision Research.

[10]  M. Georgeson,et al.  Does early non-linearity account for second-order motion? , 1999, Vision Research.

[11]  S. F. Bowne Contrast discrimination cannot explain spatial frequency, orientation or temporal frequency discrimination , 1990, Vision Research.

[12]  C. Sherrington Integrative Action of the Nervous System , 1907 .

[13]  P. Cavanagh,et al.  Subjective contours capture stereopsis , 1985, Nature.

[14]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[15]  Randolph Blake,et al.  What causes stereoscopic tilt from spatial frequency disparity , 1987, Vision Research.

[16]  J. E. W. Mayhew,et al.  A computational model of binocular depth perception , 1982, Nature.

[17]  G. F. Cooper,et al.  The angular selectivity of visual cortical cells to moving gratings , 1968, The Journal of physiology.

[18]  David J. Fleet,et al.  Linear filtering precedes nonlinear processing in early vision , 1996, Current Biology.

[19]  R. L. de Valois,et al.  Psychophysical studies of monkey vision. 3. Spatial luminance contrast sensitivity tests of macaque and human observers. , 1974, Vision research.

[20]  G. F. Cooper,et al.  The spatial selectivity of the visual cells of the cat , 1969, The Journal of physiology.

[21]  Barbara Gillam,et al.  Perspective, Orientation Disparity, and Anisotropy in Stereoscopic Slant Perception , 1992, Perception.

[22]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[23]  Charles Wheatstone On some remarkable and hitherto unobserved phenomena of binocular vision. , 1962 .

[24]  Vincent P. Ferrera,et al.  Direction specific masking and the analysis of motion in two dimensions , 1987, Vision Research.

[25]  F. Heitger,et al.  The functional role of contrast adaptation , 1988, Vision Research.

[26]  J. P. Jones,et al.  The two-dimensional spatial structure of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[27]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[28]  RussLL L. Ds Vnlos,et al.  SPATIAL FREQUENCY SELECTIVITY OF CELLS IN MACAQUE VISUAL CORTEX , 2022 .

[29]  B. Julesz Binocular depth perception of computer-generated patterns , 1960 .

[30]  G. Orban,et al.  Human orientation discrimination tested with long stimuli , 1984, Vision Research.

[31]  J P Thomas,et al.  Underlying psychometric function for detecting gratings and identifying spatial frequency. , 1983, Journal of the Optical Society of America.

[32]  G. J. Burton,et al.  Evidence for non-linear response processes in the human visual system from measurements on the thresholds of spatial beat frequencies. , 1973, Vision research.

[33]  M F Bradshaw,et al.  Disparity Scaling and the Perception of Frontoparallel Surfaces , 1995, Perception.

[34]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[35]  Vincent P. Ferrera,et al.  Perceived speed of moving two-dimensional patterns , 1991, Vision Research.

[36]  R. Blake,et al.  Spatial frequency tuning of human stereopsis , 1991, Vision Research.

[37]  J I Nelson,et al.  Globality and stereoscopic fusion in binocular vision. , 1975, Journal of theoretical biology.

[38]  C. William Tyler,et al.  Characteristics of stereomovement suppression , 1975 .

[39]  H. C. Longuet-Higgins The Role of the Vertical Dimension in Stereoscopic Vision , 1982, Perception.

[40]  B Gillam,et al.  Orientation Disparity, Deformation, and Stereoscopic Slant Perception , 1991, Perception.

[41]  Richard P. Wildes,et al.  Direct Recovery of Three-Dimensional Scene Geometry From Binocular Stereo Disparity , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Laurie M. Wilcox,et al.  Is the site of non-linear filtering in stereopsis before or after binocular combination? , 1996, Vision Research.

[43]  B. Rogers,et al.  Disparity curvature and the perception of three-dimensional surfaces , 1989, Nature.

[44]  P. Wenderoth A Visual Spatial Aftereffect of Surface Slant , 1970 .

[45]  H. Wilson,et al.  A psychophysically motivated model for two-dimensional motion perception , 1992, Visual Neuroscience.

[46]  D. W. Heeley,et al.  Spatial frequency discrimination at different orientations , 1989, Vision Research.

[47]  K. Langley,et al.  Vertical and Horizontal Disparities from Phase , 1990, ECCV.

[48]  A. Parker,et al.  An orientation-tuned component in the contrast masking of stereopsis , 1993, Vision Research.

[49]  L. Palmer,et al.  Receptive-field structure in cat striate cortex. , 1981, Journal of neurophysiology.

[50]  Christopher W. Tyler,et al.  A stereoscopic view of visual processing streams , 1990, Vision Research.

[51]  D. Broadbent,et al.  Some experiments bearing on the hypothesis that the visual system analyses spatial patterns in independent bands of spatial frequency , 1975, Vision Research.

[52]  Jitendra Malik,et al.  Determining Three-Dimensional Shape from Orientation and Spatial Frequency Disparities , 1991, ECCV.

[53]  B Gillam,et al.  Postfusional latency in stereoscopic slant perception and the primitives of stereopsis. , 1988, Journal of experimental psychology. Human perception and performance.

[54]  R. A. Smith,et al.  Disparity processing of spatial frequencies in man , 1972, The Journal of physiology.

[55]  R D Freeman,et al.  Neuronal Mechanisms Underlying Stereopsis: How Do Simple Cells in the Visual Cortex Encode Binocular Disparity? , 1995, Perception.

[56]  C. F. Stromeyer,et al.  Low spatial-frequency channels in human vision: Adaptation and masking , 1982, Vision Research.

[57]  B. Gillam,et al.  Perception of slant when perspective and stereopsis conflict: experiments with aniseikonic lenses. , 1968, Journal of experimental psychology.

[58]  I. Ohzawa,et al.  Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.

[59]  P. Wenderoth,et al.  The effect of interactions between one-dimensional component gratings on two-dimensional motion perception , 1993, Vision Research.

[60]  W E Grimson,et al.  A computer implementation of a theory of human stereo vision. , 1981, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[61]  A. Derrington,et al.  Separate detectors for simple and complex grating patterns? , 1985, Vision Research.

[62]  Daniel A. Pollen,et al.  Visual cortical neurons as localized spatial frequency filters , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[63]  D Marr,et al.  A computational theory of human stereo vision. , 1979, Proceedings of the Royal Society of London. Series B, Biological sciences.

[64]  Masanobu Yamamoto,et al.  A General Aperture Problem for Direct Estimation of 3-D Motion Parameters , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[65]  B Gillam,et al.  A Proximity-Contingent Stereoscopic Depth Aftereffect: Evidence for Adaptation to Disparity Gradients , 1993, Perception.

[66]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[67]  RANDOLPH BLAKE,et al.  Stereopsis from Interocular Spatial Frequency Differences is Not Robust , 1996, Vision Research.

[68]  M von Grünau,et al.  The effect of disparity on motion coherence. , 1993, Spatial vision.

[69]  Laurie M. Wilcox,et al.  Linear and non-linear filtering in stereopsis , 1994, Vision Research.

[70]  D. W. Heeley,et al.  Meridional anisotropies of orientation discrimination for sine wave gratings , 1988, Vision Research.

[71]  C. Blakemore,et al.  A new kind of stereoscopic vision. , 1970, Vision research.

[72]  C. Blakemore,et al.  The orientation specificity of two visual after‐effects , 1971, The Journal of physiology.

[73]  D. W. Heeley,et al.  Evidence for separate, task dependent noise processes in orientation and size perception , 1994, Vision Research.

[74]  C. Schor,et al.  Disparity range for local stereopsis as a function of luminance spatial frequency , 1983, Vision Research.

[75]  David C. Burr,et al.  Orientation discrimination depends on spatial frequency , 1991, Vision Research.

[76]  D. G. Albrecht,et al.  Striate cortex responses to periodic patterns with and without the fundamental harmonics , 1981, The Journal of physiology.

[77]  H. Wilson,et al.  Perceived direction of moving two-dimensional patterns , 1990, Vision Research.

[78]  C W Tyler,et al.  Stereoscopic Depth Movement: Two Eyes Less Sensitive than One , 1971, Science.

[79]  Leslie Welch,et al.  The perception of moving plaids reveals two motion-processing stages , 1989, Nature.

[80]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[81]  D. Heeger Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[82]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[83]  David J. Fleet,et al.  Computation of normal velocity from local phase information , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[84]  F Metelli,et al.  The perception of transparency. , 1974, Scientific American.

[85]  K. A. Stevens,et al.  The Analogy between Stereo Depth and Brightness , 1989, Perception.

[86]  David J. Fleet,et al.  Stability of Phase Information , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[87]  Eero P. Simoncelli,et al.  A computational model for perception of two-dimensional pattern ve-locities , 1992 .

[88]  C. Blakemore,et al.  Evidence for disparity detecting neurones in the human visual system , 1972, The Journal of physiology.

[89]  J. Ninio Orientational versus Horizontal Disparity in the Stereoscopic Appreciation of Slant , 1985, Perception.

[90]  A. T. Smith,et al.  The influence of spatial frequency on perceived temporal frequency and perceived speed , 1990, Vision Research.

[91]  Moirés Maintained Internally by Binocular Vision , 1978, Perception.

[92]  A. Parker,et al.  Stereo, surfaces and shape , 1991 .

[93]  J Hirsch,et al.  Limits of spatial-frequency discrimination as evidence of neural interpolation. , 1982, Journal of the Optical Society of America.

[94]  P. Thompson Perceived rate of movement depends on contrast , 1982, Vision Research.

[95]  M. Treisman,et al.  Relation between signal detectability theory and the traditional procedures for measuring sensory thresholds: Estimating d' from results given by the method of constant simuli. , 1966 .

[96]  Mark A. Georgeson,et al.  Temporal properties of spatial contrast vision , 1987, Vision Research.

[97]  David J. Fleet Measurement of image velocity , 1992 .

[98]  C. Blakemore,et al.  A second neural mechanism of binocular depth discrimination , 1972, The Journal of physiology.

[99]  B. Julesz,et al.  Independent Spatial-Frequency-Tuned Channels in Binocular Fusion and Rivalry , 1975 .

[100]  H. Wilson,et al.  Coarse spatial scales constrain the range of binocular fusion on fine scales. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[101]  D. G. Albrecht,et al.  Visual cortical receptive fields in monkey and cat: Spatial and temporal phase transfer function , 1989, Vision Research.

[102]  R. Heydt,et al.  THE ROLE OF ORIENTATION DISPARITY IN STEREOSCOPIC PERCEPTION AND THE DEVELOPMENT OF BINOCULAR CORRESPONDENCE , 1981 .

[103]  H. Wallach,et al.  Two forms of retinal disparity , 1976 .

[104]  John K. Tsotsos,et al.  Techniques for disparity measurement , 1991, CVGIP Image Underst..

[105]  G. Legge A power law for contrast discrimination , 1981, Vision Research.

[106]  Ian P. Howard,et al.  Binocular fusion and rivalry , 1996 .

[107]  Mary M. Conte,et al.  Coherence and transparency of moving plaids composed of Fourier and non-Fourier gratings , 1992, Perception & psychophysics.

[108]  Gregory C. DeAngelis,et al.  Depth is encoded in the visual cortex by a specialized receptive field structure , 1991, Nature.

[109]  Hans Knutsson,et al.  Filtering and reconstruction in image processing , 1984 .

[110]  H. Smallman Fine-to-coarse scale disambiguation in stereopsis , 1995, Vision Research.

[111]  Vision: Mechanisms for coding luminance patterns: are they really linear? , 1991 .

[112]  Kenneth J. Ciuffreda Binocular Vision and Stereopsis , 1998 .

[113]  A. T. Smith,et al.  Perceived speed and direction of complex gratings and plaids. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[114]  Hugh R. Wilson,et al.  10 – THE PERCEPTION OF FORM: Retina to Striate Cortex , 1989 .

[115]  C. Blakemore,et al.  Orientation Specificity and Spatial Selectivity in Human Vision , 1973, Perception.

[116]  R. Blake,et al.  How Contrast Affects Stereoacuity , 1988, Perception.

[117]  S Marcelja,et al.  Mathematical description of the responses of simple cortical cells. , 1980, Journal of the Optical Society of America.

[118]  J P Frisby,et al.  The Computation of Binocular Edges , 1980, Perception.

[119]  S. Freguia Researches in Binocular Vision. , 1950 .

[120]  Casper J. Erkelens,et al.  Temporal aspects of binocular slant perception , 1996, Vision Research.

[121]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[122]  S. McKee,et al.  Mechanisms underlying the anisotropy of stereoscopic tilt perception , 1990, Vision Research.

[123]  A. W. Volkmann,et al.  Physiologische Untersuchungen im Gebiete der Optik , 1863 .

[124]  Kenneth N. Ogle,et al.  INDUCED SIZE EFFECT: I. A NEW PHENOMENON IN BINOCULAR SPACE PERCEPTION ASSOCIATED WITH THE RELATIVE SIZES OF THE IMAGES OF THE TWO EYES , 1938 .

[125]  H. Spitzer,et al.  A complex-cell receptive-field model. , 1985, Journal of neurophysiology.

[126]  E. Adelson,et al.  Directionally selective complex cells and the computation of motion energy in cat visual cortex , 1992, Vision Research.

[127]  D. Kersten Transparency and the cooperative computation of scene attributes , 1991 .

[128]  S. Fernberger A figural after-effect in the third dimension of visual space. , 1948, The American journal of psychology.

[129]  David J. Fleet,et al.  Neural encoding of binocular disparity: Energy models, position shifts and phase shifts , 1996, Vision Research.

[130]  T. D. Albright,et al.  Transparency and coherence in human motion perception , 1990, Nature.

[131]  E. Adelson,et al.  The analysis of moving visual patterns , 1985 .

[132]  F. Campbell,et al.  The influence of spatial frequency and contrast on the perception of moving patterns , 1981, Vision Research.

[133]  B. Rogers,et al.  Anisotropies in the perception of stereoscopic surfaces: The role of orientation disparity , 1993, Vision Research.

[134]  Andrew M. Derrington Distortion products in geniculate X-cells: A physiological basis for masking by spatially modulated gratings? , 1987, Vision Research.

[135]  P. Bressan,et al.  Occlusion, transparency, and stereopsis: A new explanation for stereo capture , 1994, Vision Research.

[136]  K. A. Stevens Surface tilt (the direction of slant): A neglected psychophysical variable , 1983, Perception & psychophysics.

[137]  M. J. Mayer,et al.  Smooth frequency discrimination functions for foveal, high-contrast, mid spatial frequencies. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[138]  G. Sperling,et al.  Drift-balanced random stimuli: a general basis for studying non-Fourier motion perception. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[139]  V. Ramachandran,et al.  Transparency: Relation to Depth, Subjective Contours, Luminance, and Neon Color Spreading , 1990, Perception.

[140]  Binocular Depth Perception , 1960, Nature.

[141]  M. Georgeson,et al.  Perceived contrast of gratings and plaids: Non-linear summation across oriented filters , 1994, Vision Research.

[142]  Keith Langley,et al.  Computational analysis of non-Fourier motion , 1994, Vision Research.

[143]  D. Pollen,et al.  Phase relationships between adjacent simple cells in the visual cortex. , 1981, Science.

[144]  G. Poggio,et al.  Binocular interaction and depth sensitivity in striate and prestriate cortex of behaving rhesus monkey. , 1977, Journal of neurophysiology.

[145]  Andrea J. van Doorn,et al.  Invariant Properties of the Motion Parallax Field due to the Movement of Rigid Bodies Relative to an Observer , 1975 .