From filters to features: location, orientation, contrast and blur.

Consider three main ideas about spatial filtering and feature coding in human spatial vision. (1) Computational theory: the representation of local luminance features--bars and edges--is a crucial step in human vision, forming the basis for many decisions in pattern discrimination. (2) Algorithm: features may be located and characterized in terms of polarity, blur and contrast by comparison of 1st, 2nd and 3rd spatial derivatives taken at a common point. Edges in compound (f + 3f) gratings are seen at or close to peaks of gradient magnitude. More tentatively, bars may be located at peaks of the 2nd derivative or at peaks in the Hilbert transform of the 1st derivative. Peaks of contrast energy do not predict all the features seen. An algorithm for recovering the blur of edges is derived as the square-root of the ratio of 1st to 3rd derivatives at the edge location. This successfully predicts blur matching between Gaussian edges and a variety of other test waveforms, including sine waves. Blur matching is (nearly) contrast invariant, as predicted by this ratio rule. (3) IMPLEMENTATION: experiments on the perception and discrimination of plaids imply that the outputs of tuned filters are combined before feature coding. The adaptive, weighted summation of bandpass filters may serve to synthesize the derivative operators while facilitating the segmentation of overlapping features and preventing the representation from being swamped by noise.

[1]  D Regan,et al.  Independence of orientation and size in spatial discriminations. , 1983, Journal of the Optical Society of America.

[2]  D. Regan Storage of spatial-frequency information and spatial-frequency discrimination , 1985 .

[3]  D. Tolhurst,et al.  Amplitude spectra of natural images , 1992 .

[4]  C. A. Burbeck,et al.  Locus of spatial-frequency discrimination. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[5]  R. Watt,et al.  A theory of the primitive spatial code in human vision , 1985, Vision Research.

[6]  R. F. Hess,et al.  Evidence for spatially local computations underlying discrimination of periodic patterns in fovea and periphery , 1987, Vision Research.

[7]  Robyn A. Owens,et al.  Feature detection from local energy , 1987, Pattern Recognit. Lett..

[8]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[9]  Lynn A. Olzak,et al.  Configural effects constrain fourier models of pattern discrimination , 1992, Vision Research.

[10]  Lynn A. Olzak,et al.  When orthogonal orientations are not processed independently , 1991, Vision Research.

[11]  S. Klein,et al.  Positional uncertainty in peripheral and amblyopic vision , 1987, Vision Research.

[12]  S. F. Bowne Contrast discrimination cannot explain spatial frequency, orientation or temporal frequency discrimination , 1990, Vision Research.

[13]  D. Badcock How do we discriminate relative spatial phase? , 1984, Vision Research.

[14]  Arthur Bradley,et al.  The effects of large orientation and spatial frequency differences on spatial discriminations , 1984, Vision Research.

[15]  D Regan,et al.  Masking of spatial-frequency discrimination. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[16]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[17]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[18]  C. Blakemore,et al.  The Site of Size Constancy , 1972, Perception.

[19]  Mark W. Greenlee,et al.  Stimulus-specific mechanisms of visual short-term memory , 1991, Vision Research.

[20]  H. Wilson,et al.  Modified line-element theory for spatial-frequency and width discrimination. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[21]  H. Wilson Psychophysical Evidence for Spatial Channels , 1983 .

[22]  M. Georgeson Human vision combines oriented filters to compute edges , 1992, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[23]  R. Haralick,et al.  The Topographic Primal Sketch , 1983 .

[24]  Andrew B. Watson,et al.  Detection and Recognition of Simple Spatial Forms , 1983 .

[25]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[26]  D Regan,et al.  Visual Judgements and Misjudgements in Cricket, and the Art of Flight , 1992, Perception.

[27]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[28]  R. J. Watt,et al.  Intensity-response nonlinearities and the theory of edge localization , 1984, Vision Research.

[29]  Robyn A. Owens,et al.  Image Compression and Reconstruction Using a 1-D Feature Catalogue , 1992, ECCV.

[30]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.