Edge-finding in human vision: a multi-stage model based on the perceived structure of plaids

Abstract Visual experiments on the perceived structure of plaid patterns are reported and reviewed. Plaids composed of two or three sinusoidal grating components were viewed both with and without the influence of masking or adapting patterns. The results lead to the outline of a multi-stage model of the processes by which human vision derives edge-feature descriptions from the retinal image via local spatial filters. The main proposed stages are: (i) local, oriented filtering; (ii) local combination of filter outputs across orientation (or spatial frequency) to form (iii) filtered image ‘patches’; (iv) coherent combination of patches across space to form a ‘neural image’; (v) zero-crossing analysis on the neural image to localize edge features in (vi) a feature map; (vii) application of coding rules to describe feature attributes at zero-crossing locations. Evidence for the filter combination and zero-crossing stages [(ii) and (v)] comes from experiments on the perceived structure of plaids, where the perceived location and orientation of edges was predicted by zero-crossings in the output of a circular filter, and not by the Fourier component orientations. By contrast, results on the tilt aftereffect for plaids could be understood entirely as an interaction between Fourier components, but with consequential changes in the perception of ZCs that required a consideration of ‘patchwise’ analysis and the patch combination stage [(iii) and (iv)]. Theory and evidence for coding rules (vii) that describe the blur, contrast and orientation of local edge features are discussed.

[1]  S. Mann,et al.  Ciba Foundation Symposium , 1997 .

[2]  Colin Blakemore,et al.  Vision: Coding and Efficiency , 1991 .

[3]  Mark A. Georgeson,et al.  Eye movements, afterimages and monocular rivalry , 1984, Vision Research.

[4]  M. Georgeson,et al.  Perceived contrast of gratings and plaids: Non-linear summation across oriented filters , 1994, Vision Research.

[5]  H. Wilson Psychophysical Evidence for Spatial Channels , 1983 .

[6]  M. Coltheart Visual feature-analyzers and after-effects of tilt and curvature. , 1971, Psychological review.

[7]  M. Georgeson Human vision combines oriented filters to compute edges , 1992, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[8]  G. Blasdel,et al.  Orientation selectivity, preference, and continuity in monkey striate cortex , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  G. Legge Sustained and transient mechanisms in human vision: Temporal and spatial properties , 1978, Vision Research.

[10]  V Kayargadde,et al.  Estimation of perceived image blur , 1994 .

[11]  R. F. Hess,et al.  Evidence for spatially local computations underlying discrimination of periodic patterns in fovea and periphery , 1987, Vision Research.

[12]  T. Meese,et al.  Edge Computation in Human Vision: Anisotropy in the Combining of Oriented Filters , 1995, Perception.

[13]  David J. Field,et al.  What The Statistics Of Natural Images Tell Us About Visual Coding , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[14]  N. Graham Non-linearities in texture segregation. , 1994, Ciba Foundation symposium.

[15]  Andrew C. Sleigh,et al.  Physical and Biological Processing of Images , 1983 .

[16]  M. Georgeson,et al.  Afterimages of sinusoidal, square-wave and compound gratings , 1985, Vision Research.

[17]  R. Haralick,et al.  The Topographic Primal Sketch , 1983 .

[18]  M A Georgeson,et al.  From filters to features: location, orientation, contrast and blur. , 1994, Ciba Foundation symposium.

[19]  Geoffrey M. Boynton,et al.  Forward pattern masking and adaptation: Effects of duration, interstimulus interval, contrast, and spatial and temporal frequency , 1993, Vision Research.

[20]  M. Georgeson,et al.  Facilitation and masking of briefly presented gratings: Time-course and contrast dependence , 1987, Vision Research.

[21]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[22]  Lynn A. Olzak,et al.  Configural effects constrain fourier models of pattern discrimination , 1992, Vision Research.

[23]  Vision: Algotecture of visual cortex , 1991 .

[24]  Lynn A. Olzak,et al.  When orthogonal orientations are not processed independently , 1991, Vision Research.

[25]  Janette Atkinson,et al.  Channels in Vision: Basic Aspects , 1978 .

[26]  A B Watson,et al.  Efficiency of a model human image code. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[27]  Jyrki Rovamo,et al.  Contrast matching of two-dimensional compound gratings , 1994, Vision Research.

[28]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[29]  M. Georgeson,et al.  Spatial selectivity of contrast adaptation: Models and data , 1984, Vision Research.

[30]  M. Georgeson,et al.  The tilt aftereffect in plaids and gratings: channel codes, local signs and “patchwise” transforms , 1996, Vision Research.

[31]  H C Nothdurft,et al.  Common properties of visual segmentation. , 1994, Ciba Foundation symposium.

[32]  F. Campbell,et al.  The tilt after-effect: a fresh look. , 1971, Vision research.

[33]  Mark W. Cannon,et al.  A transducer model for contrast perceptio , 1991, Vision Research.

[34]  J. Gibson,et al.  Adaptation, after-effect and contrast in the perception of tilted lines. I. Quantitative studies , 1937 .

[35]  C. Blakemore,et al.  Size Adaptation: A New Aftereffect , 1969, Science.

[36]  M. Georgeson The Perceived Spatial Frequency, Contrast, and Orientation of Illusory Gratings , 1980, Perception.

[37]  Mark A. Georgeson,et al.  Perceived structure of plaids implies variable combination of oriented filters in edge finding , 1996, Electronic Imaging.

[38]  M. Silverman,et al.  Spatial-frequency organization in primate striate cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[39]  J P Thomas,et al.  Independent processing of suprathreshold spatial gratings as a function of their separation in spatial frequency. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[40]  Chuan Yi Tang,et al.  A 2.|E|-Bit Distributed Algorithm for the Directed Euler Trail Problem , 1993, Inf. Process. Lett..

[41]  M. Georgeson,et al.  Perception of stationary plaids: The role of spatial filters in edge analysis , 1997, Vision Research.

[42]  Andrew B. Watson,et al.  The cortex transform: rapid computation of simulated neural images , 1987 .

[43]  N. S. Sutherland Tutorial Essays in Psychology : Volume 1 , 1978 .

[44]  R A Young,et al.  The Gaussian derivative model for spatial vision: I. Retinal mechanisms. , 1988, Spatial vision.

[45]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[46]  R. Watt,et al.  Spatial filters and the localization of luminance changes in human vision , 1984, Vision Research.

[47]  R B Tootell,et al.  Spatial frequency tuning of single units in macaque supragranular striate cortex. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[48]  W Makous,et al.  Undetected gray strips displace perceived edges nonlinearly. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[49]  A. Grinvald,et al.  Relationships between orientation-preference pinwheels, cytochrome oxidase blobs, and ocular-dominance columns in primate striate cortex. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[50]  D. Heeger Half-squaring in responses of cat striate cells , 1992, Visual Neuroscience.

[51]  John G. Daugman,et al.  Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression , 1988, IEEE Trans. Acoust. Speech Signal Process..

[52]  Jean-Bernard Martens,et al.  Estimation of Edge Parameters and Image Blur Using Polynomial Transforms , 1994, CVGIP Graph. Model. Image Process..

[53]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[54]  Robert J. Snowden,et al.  Orientation bandwidth: The effect of spatial and temporal frequency , 1992, Vision Research.

[55]  K. Obermayer,et al.  Geometry of orientation and ocular dominance columns in monkey striate cortex , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[56]  C. A. Burbeck,et al.  Further evidence for a broadband, isotropic mechanism sensitive to high-velocity stimuli , 1987, Vision Research.

[57]  M. Georgeson,et al.  Contrast constancy: deblurring in human vision by spatial frequency channels. , 1975, The Journal of physiology.

[58]  George Mather,et al.  Irradiation: Implications for theories of edge localization , 1986, Vision Research.

[59]  M. Georgeson,et al.  Perceived Location of Bars and Edges in One-dimensional Images: Computational Models and Human Vision , 1997, Vision Research.

[60]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.