Simulation of neural contour mechanisms: from simple to end-stopped cells

Early stages of visual form processing were modelled by simulating cortical simple, complex and end-stopped cells. The computation involves (1) convolution of the image with even and odd symmetrical orientation selective filters (S-operators), (2) combination of even and odd filter outputs to a local energy measure (C-operator), (3) "differentiation" of the C-operator maps along the respective orientation (single and double end-stopped operators) and (4) determination of local maxima ("key-points") of the combined end-stopped operator activity. While S- and C-operators are optimised for the representation of 1-D features such as edges and lines, the end-stopped operator responses at the key-points make explicit 2-D signal variations such as line ends, corners and segments of strong curvature. The theoretical need for this complementary representation is discussed. The model was tested on grey-valued images.

[1]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  Esther Peterhans,et al.  Elements of form perception in monkey prestriate cortex , 1991 .

[3]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[4]  L. Finkel,et al.  Integration of distributed cortical systems by reentry: a computer simulation of interactive functionally segregated visual areas , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  D. Pollen,et al.  Phase relationships between adjacent simple cells in the visual cortex. , 1981, Science.

[6]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[7]  P. O. Bishop,et al.  End-zone region in receptive fields of hypercomplex and other striate neurons in the cat. , 1979, Journal of neurophysiology.

[8]  R. von der Heydt,et al.  Illusory contours and cortical neuron responses. , 1984, Science.

[9]  S Grossberg,et al.  Neural dynamics of brightness perception: Features, boundaries, diffusion, and resonance , 1984, Perception & Psychophysics.

[10]  J Allman,et al.  Direction- and Velocity-Specific Responses from beyond the Classical Receptive Field in the Middle Temporal Visual Area (MT) , 1985, Perception.

[11]  R. von der Heydt,et al.  Mechanisms of contour perception in monkey visual cortex. I. Lines of pattern discontinuity , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  S. Grossberg,et al.  15 – COMPUTATIONAL THEORIES OF VISUAL PERCEPTION , 1990 .

[13]  John Daugman,et al.  Six formal properties of two-dimensional anisotropie visual filters: Structural principles and frequency/orientation selectivity , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[14]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  D. Burr,et al.  Evidence for edge and bar detectors in human vision , 1989, Vision Research.

[16]  J. Nelson,et al.  Orientation-selective inhibition from beyond the classic visual receptive field , 1978, Brain Research.

[17]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[18]  L. Palmer,et al.  The two-dimensional spatial structure of nonlinear subunits in the receptive fields of complex cells , 1990, Vision Research.

[19]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[20]  G. Orban,et al.  Responses of visual cortical neurons to curved stimuli and chevrons , 1990, Vision Research.

[21]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[22]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[23]  C. Zetzsche,et al.  Fundamental limits of linear filters in the visual processing of two-dimensional signals , 1990, Vision Research.

[24]  KUNIHIKO FUKUSHIMA,et al.  Visual Feature Extraction by a Multilayered Network of Analog Threshold Elements , 1969, IEEE Trans. Syst. Sci. Cybern..

[25]  D. Pollen,et al.  Spatial computation performed by simple and complex cells in the visual cortex of the cat , 1982, Vision Research.

[26]  D. Rose.  Responses of single units in cat visual cortex to moving bars of light as a function of bar length , 1977, The Journal of physiology.

[27]  Michael Brady,et al.  The Curvature Primal Sketch , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  R. von der Heydt,et al.  Mechanisms of contour perception in monkey visual cortex. II. Contours bridging gaps , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  D. G. Albrecht,et al.  Periodicity of striate-cortex-cell receptive fields. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[30]  P. Schiller,et al.  Quantitative studies of single-cell properties in monkey striate cortex. I. Spatiotemporal organization of receptive fields. , 1976, Journal of neurophysiology.

[31]  P. Kellman,et al.  A theory of visual interpolation in object perception , 1991, Cognitive Psychology.

[32]  Jeffrey A. Sloan,et al.  Spatial frequency analysis of the visual environment: Anisotropy and the carpentered environment hypothesis , 1978, Vision Research.

[33]  P. O. Bishop,et al.  Dimensions and properties of end-zone inhibitory areas in receptive fields of hypercomplex cells in cat striate cortex. , 1979, Journal of neurophysiology.

[34]  S. Zucker,et al.  Endstopped neurons in the visual cortex as a substrate for calculating curvature , 1987, Nature.

[35]  D. Burr,et al.  Functional implications of cross-orientation inhibition of cortical visual cells. I. Neurophysiological evidence , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[36]  P. O. Bishop,et al.  Striate neurons: receptive field concepts. , 1972, Investigative ophthalmology.

[37]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[38]  S. Zucker,et al.  Endstopping and curvature , 1989, Vision Research.

[39]  L. Maffei,et al.  The visual cortex as a spatial frequency analyser. , 1973, Vision research.

[40]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[41]  J. Movshon,et al.  Receptive field organization of complex cells in the cat's striate cortex. , 1978, The Journal of physiology.

[42]  R. Watt,et al.  A theory of the primitive spatial code in human vision , 1985, Vision Research.

[43]  S. Coren,et al.  SUBJECTIVE CONTOURS AND APPARENT DEPTH , 2005 .

[44]  P. O. Bishop,et al.  Receptive fields of simple cells in the cat striate cortex , 1973, The Journal of physiology.

[45]  L. Maffei,et al.  The unresponsive regions of visual cortical receptive fields , 1976, Vision Research.

[46]  D H HUBEL,et al.  RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT. , 1965, Journal of neurophysiology.

[47]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.