Cortically-inspired visual processing with a four layer cellular neural network

This paper describes a four layer cellular neural network architecture implementing image processing inspired by the functionality of neurons in the visual cortex: linear orientation selective filtering and half wave rectification. The network implements both even and odd symmetric Gabor-like filters simultaneously, with pairs of layers representing the positive and negative components of the filter outputs. Each layer is an array of analog nonlinear continuous time processing elements ("cells" or "neurons"), each corresponding to one pixel in the image. Because neurons are feedback interconnected only with neurons from nearest neighbor pixels, we can easily implement this network in VLSI. For example, a recent implementation filters a 32 x 64 pixel image in parallel within a few milliseconds while dissipating only a few milliwatts. This paper analyzes the dynamics of this network mathematically, deriving the spatial transfer functions of the orientation selective filters and proving stability.

[1]  S Marcelja,et al.  Mathematical description of the responses of simple cortical cells. , 1980, Journal of the Optical Society of America.

[2]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[3]  Bertram E. Shi,et al.  Gabor-type filtering in space and time with cellular neural networks , 1998 .

[4]  Bertram E. Shi A low-power orientation-selective vision sensor , 2000 .

[5]  I. Ohzawa,et al.  Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. , 1990, Science.

[6]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[7]  Daniel A. Pollen,et al.  Visual cortical neurons as localized spatial frequency filters , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  Bertram E. Shi,et al.  An orientation selective 2D AER transceiver , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[9]  D. Heeger Half-squaring in responses of cat striate cells , 1992, Visual Neuroscience.

[10]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[11]  J. Daugman Two-dimensional spectral analysis of cortical receptive field profiles , 1980, Vision Research.

[12]  D. Ringach Spatial structure and symmetry of simple-cell receptive fields in macaque primary visual cortex. , 2002, Journal of neurophysiology.

[13]  C. Baker,et al.  Processing of second-order stimuli in the visual cortex. , 2001, Progress in brain research.

[14]  J. P. Jones,et al.  An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[15]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[16]  D. G. Albrecht,et al.  Motion selectivity and the contrast-response function of simple cells in the visual cortex , 1991, Visual Neuroscience.