Biologically Motivated Computer Vision

Recent experimental work has shown that the primate visual system can analyze complex natural scenes in only 100-150 ms. Such data, when combined with anatomical and physiological knowledge, seriously constrains current models of visual processing. In particular, it suggests that a lot of processing can be achieved using a single feed-forward pass through the visual system, and that each processing layer probably has no more than around 10 ms before the next stage has to respond. In this time, few neurons will have generated more than one spike, ruling out most conventional rate coding models. We have been exploring the possibility of using the fact that strongly activated neurons tend to fire early and that information can be encoded in the order in which a population of cells fire. These ideas have been tested using SpikeNet, a computer program that simulates the activity of very large networks of asynchronously firing neurons. The results have been extremely promising, and we have been able to develop artificial visual systems capable of processing complex natural scenes in real time using standard computer hardware (see http://www.spikenet-technology.com).

[1]  M. Wertheimer.  Laws of organization in perceptual forms. , 1938 .

[2]  F. Attneave.  Some informational aspects of visual perception. , 1954, Psychological review.

[3]  Tadasu Oyama,et al.  Perceptual Grouping as a Function of Proximity , 1961 .

[4]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[5]  F Metelli,et al.  The perception of transparency. , 1974, Scientific American.

[6]  J. Lund,et al.  Intrinsic laminar lattice connections in primate visual cortex , 1983, The Journal of comparative neurology.

[7]  D. J. Felleman,et al.  Receptive-field properties of neurons in middle temporal visual area (MT) of owl monkeys. , 1984, Journal of neurophysiology.

[8]  S. Grossberg,et al.  Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading. , 1985, Psychological review.

[9]  I. Biederman.  Human image understanding: Recent research and a theory , 1985, Computer Vision Graphics and Image Processing.

[10]  G. Orban,et al.  Velocity sensitivity and direction selectivity of neurons in areas V1 and V2 of the monkey: influence of eccentricity. , 1986, Journal of neurophysiology.

[11]  Christopher G. Harris,et al.  Determination of Ego-Motion from Matched Points , 1987, Alvey Vision Conference.

[12]  Steven W. Zucker,et al.  Two Stages of Curve Detection Suggest Two Styles of Visual Computation , 1989, Neural Computation.

[13]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  C. Zetzsche,et al.  Fundamental limits of linear filters in the visual processing of two-dimensional signals , 1990, Vision Research.

[15]  C. Gilbert,et al.  Synaptic physiology of horizontal connections in the cat's visual cortex , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  Mark Nitzberg,et al.  Nonlinear Image Filtering with Edge and Corner Enhancement , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[18]  James Elder,et al.  The effect of contour closure on the rapid discrimination of two-dimensional shapes , 1993, Vision Research.

[19]  A. Ravishankar Rao,et al.  Identifying High Level Features of Texture Perception , 1993, CVGIP Graph. Model. Image Process..

[20]  G. Orban,et al.  Speed and direction selectivity of macaque middle temporal neurons. , 1993, Journal of neurophysiology.

[21]  A. Oliva,et al.  From Blobs to Boundary Edges: Evidence for Time- and Spatial-Scale-Dependent Scene Recognition , 1994 .

[22]  M. Graziano,et al.  Tuning of MST neurons to spiral motions , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  T. Sejnowski,et al.  A selection model for motion processing in area MT of primates , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  G. Sperling,et al.  Measuring the spatial frequency selectivity of second-order texture mechanisms , 1995, Vision Research.

[25]  Steven W. Zucker,et al.  Computing Contour Closure , 1996, ECCV.

[26]  R A Andersen,et al.  Neural responses to velocity gradients in macaque cortical area MT , 1996, Visual Neuroscience.

[27]  Steven W. Zucker,et al.  Local Scale Control for Edge Detection and Blur Estimation , 1996, ECCV.

[28]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[29]  R. M. Siegel,et al.  Analysis of optic flow in the monkey parietal area 7a. , 1997, Cerebral cortex.

[30]  D. Fitzpatrick,et al.  Orientation Selectivity and the Arrangement of Horizontal Connections in Tree Shrew Striate Cortex , 1997, The Journal of Neuroscience.

[31]  T J Sejnowski,et al.  A Model for Encoding Multiple Object Motions and Self-Motion in Area MST of Primate Visual Cortex , 1998, The Journal of Neuroscience.

[32]  Martin Szummer,et al.  Indoor-outdoor image classification , 1998, Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database.

[33]  M. Kubovy,et al.  On the Lawfulness of Grouping by Proximity , 1998, Cognitive Psychology.

[34]  R. Desimone,et al.  Responses of Neurons in Inferior Temporal Cortex during Memory- Guided Visual Search , 1998 .

[35]  Eero P. Simoncelli,et al.  A model of neuronal responses in visual area MT , 1998, Vision Research.

[36]  Charles A. Bouman,et al.  Perceptual image similarity experiments , 1998, Electronic Imaging.

[37]  Farzin Mokhtarian,et al.  Robust Image Corner Detection Through Curvature Scale Space , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  G. Caputo,et al.  Attentional selection by distractor suppression , 1998, Vision Research.

[39]  Sir G. Archaeopteryx.  Object-based attention in the primary visual cortex of the macaque monkey , 1998 .

[40]  James H. Elder,et al.  Image editing in the contour domain , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[41]  J A Perrone,et al.  Emulating the Visual Receptive-Field Properties of MST Neurons with a Template Model of Heading Estimation , 1998, The Journal of Neuroscience.

[42]  L M Vaina,et al.  Computational modelling of optic flow selectivity in MSTd neurons. , 1998, Network.

[43]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[44]  R. Desimone,et al.  Competitive Mechanisms Subserve Attention in Macaque Areas V2 and V4 , 1999, The Journal of Neuroscience.

[45]  F. Kingdom,et al.  On the mechanism for scale invariance in orientation-defined textures , 1999, Vision Research.

[46]  Eileen Kowler,et al.  Attentional interference at small spatial separations , 1999, Vision Research.

[47]  Heiko Neumann,et al.  A model of V1 visual contrast processing utilizing long-range connections and recurrent interactions , 1999 .

[48]  Lindsay William Macdonald,et al.  Colour Imaging: Vision and Technology , 1999 .

[49]  Jaihie Kim,et al.  A Fast Circular Edge Detector for the Iris Region Segmentation , 2000, Biologically Motivated Computer Vision.

[50]  Neural field model for the recognition of biological motion patterns , 2000 .

[51]  Gordon Cheng,et al.  A Humanoid Vision System for Versatile Interaction , 2000, Biologically Motivated Computer Vision.

[52]  Christopher C. Pack,et al.  A Neural Model of Smooth Pursuit Control and Motion Perception by Cortical Area MST , 2001, Journal of Cognitive Neuroscience.

[53]  C. Connor,et al.  Shape representation in area V4: position-specific tuning for boundary conformation. , 2001, Journal of neurophysiology.

[54]  Stephen Grossberg,et al.  Neural dynamics of motion integration and segmentation within and across apertures , 2001, Vision Research.

[55]  N Rubin,et al.  The Role of Junctions in Surface Completion and Contour Matching , 2001, Perception.

[56]  Heiko Neumann,et al.  Neural Mechanisms for Representing Surface and Contour Features , 2001, Emergent Neural Computational Architectures Based on Neuroscience.

[57]  Antonio Torralba,et al.  Contextual Modulation of Target Saliency , 2001, NIPS.

[58]  Antonio Torralba,et al.  Statistical Context Priming for Object Detection , 2001, ICCV.

[59]  J. Elder,et al.  Ecological statistics of Gestalt laws for the perceptual organization of contours. , 2002, Journal of vision.

[60]  Antonio Torralba,et al.  Depth Estimation from Image Structure , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[61]  T. Meese,et al.  Spiral mechanisms are required to account for summation of complex motion components , 2002, Vision Research.

[62]  Raj Shekhar,et al.  Mutual information-based rigid and nonrigid registration of ultrasound volumes , 2002, IEEE Transactions on Medical Imaging.

[63]  Thorsten Hansen,et al.  A neural model of early vision: contrast, contours, corners and surfaces: contributions toward an integrative architecture of form and brightness perception , 2003 .

[64]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[65]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[66]  David J. Heeger,et al.  Optical flow using spatiotemporal filters , 2004, International Journal of Computer Vision.

[67]  James H. Elder,et al.  Are Edges Incomplete? , 1999, International Journal of Computer Vision.

[68]  E. Adelson.  24 Lightness Perception and Lightness Illusions , 2022 .