A Push-Pull CORF Model of a Simple Cell with Antiphase Inhibition Improves SNR and Contour Detection

We propose a computational model of a simple cell with push-pull inhibition, a property that is observed in many real simple cells. It is based on an existing model called Combination of Receptive Fields or CORF for brevity. A CORF model uses as afferent inputs the responses of model LGN cells with appropriately aligned center-surround receptive fields, and combines their output with a weighted geometric mean. The output of the proposed model simple cell with push-pull inhibition, which we call push-pull CORF, is computed as the response of a CORF model cell that is selective for a stimulus with preferred orientation and preferred contrast minus a fraction of the response of a CORF model cell that responds to the same stimulus but of opposite contrast. We demonstrate that the proposed push-pull CORF model improves signal-to-noise ratio (SNR) and achieves further properties that are observed in real simple cells, namely separability of spatial frequency and orientation as well as contrast-dependent changes in spatial frequency tuning. We also demonstrate the effectiveness of the proposed push-pull CORF model in contour detection, which is believed to be the primary biological role of simple cells. We use the RuG (40 images) and Berkeley (500 images) benchmark data sets of images with natural scenes and show that the proposed model outperforms, with very high statistical significance, the basic CORF model without inhibition, Gabor-based models with isotropic surround inhibition, and the Canny edge detector. The push-pull CORF model that we propose is a contribution to a better understanding of how visual information is processed in the brain as it provides the ability to reproduce a wider range of properties exhibited by real simple cells. As a result of push-pull inhibition a CORF model exhibits an improved SNR, which is the reason for a more effective contour detection.

[1]  D. Burr,et al.  Functional implications of cross-orientation inhibition of cortical visual cells. I. Neurophysiological evidence , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[3]  P. H. Schiller,et al.  Spatial frequency and orientation tuning dynamics in area V1 , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[4]  H. Neumann,et al.  Extraction of Surface-Related Features in a Recurrent Model of V1-V2 Interactions , 2009, PloS one.

[5]  L. Martinez,et al.  Circuits that build visual cortical receptive fields , 2006, Trends in Neurosciences.

[6]  George Azzopardi,et al.  Automatic detection of vascular bifurcations in segmented retinal images using trainable COSFIRE filters , 2013, Pattern Recognit. Lett..

[7]  A. Parker,et al.  Spatial properties of neurons in the monkey striate cortex , 1987, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[8]  D. Ferster,et al.  Neural mechanisms of orientation selectivity in the visual cortex. , 2000, Annual review of neuroscience.

[9]  J. Alonso,et al.  Population receptive fields of ON and OFF thalamic inputs to an orientation column in visual cortex , 2011, Nature Neuroscience.

[10]  Leena A. Ibrahim,et al.  Broadening of Inhibitory Tuning Underlies Contrast-Dependent Sharpening of Orientation Selectivity in Mouse Visual Cortex , 2012, The Journal of Neuroscience.

[11]  M. Carandini,et al.  Orientation tuning of input conductance, excitation, and inhibition in cat primary visual cortex. , 2000, Journal of neurophysiology.

[12]  R. L. de Valois,et al.  Relationship between spatial-frequency and orientation tuning of striate-cortex cells. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[13]  P. Heggelund.  Quantitative studies of enhancement and suppression zones in the receptive field of simple cells in cat striate cortex. , 1986, The Journal of physiology.

[14]  George Azzopardi,et al.  A CORF computational model of a simple cell that relies on LGN input outperforms the Gabor function model , 2012, Biological Cybernetics.

[15]  Charles Gross,et al.  Inferior temporal cortex , 2008, Scholarpedia.

[16]  Christopher K. I. Williams,et al.  Transformation Equivariant Boltzmann Machines , 2011, ICANN.

[17]  R. Reid,et al.  Synaptic Integration in Striate Cortical Simple Cells , 1998, The Journal of Neuroscience.

[18]  S. Schultz.  Principles of Neural Science, 4th ed. , 2001 .

[19]  George Azzopardi,et al.  Trainable COSFIRE Filters for Keypoint Detection and Pattern Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Bartlett W. Mel,et al.  Translation-Invariant Orientation Tuning in Visual “Complex” Cells Could Derive from Intradendritic Computations , 1998, The Journal of Neuroscience.

[21]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[22]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[23]  Nicolai Petkov,et al.  Suppression of contour perception by band-limited noise and its relation to nonclassical receptive field inhibition , 2003, Biological cybernetics.

[24]  Trichur Raman Vidyasagar,et al.  Relationship between orientation tuning and spatial frequency in neurones of cat area 17 , 2004, Experimental Brain Research.

[25]  George Azzopardi,et al.  Contour Detection by CORF Operator , 2012, ICANN.

[26]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[27]  R. Reid,et al.  Receptive field structure varies with layer in the primary visual cortex , 2005, Nature Neuroscience.

[28]  J. Bosch,et al.  Sinusoidal Endothelial Dysfunction Precedes Inflammation and Fibrosis in a Model of NAFLD , 2012, PloS one.

[29]  B. Robertson.  A celebration of the 50th anniversary of David Hubel and Torsten Wiesel's Receptive fields of single neurones in the cat's striate cortex , 2009, The Journal of physiology.

[30]  Guy A Orban,et al.  Higher order visual processing in macaque extrastriate cortex. , 2008, Physiological reviews.

[31]  Nicolai Petkov,et al.  Contour detection based on nonclassical receptive field inhibition , 2003, IEEE Trans. Image Process..

[32]  Gregory C. DeAngelis,et al.  Receptive-field dynamics in the central visual pathways , 1995, Trends in Neurosciences.

[33]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[34]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[35]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[36]  L. Palmer,et al.  Receptive-field structure in cat striate cortex. , 1981, Journal of neurophysiology.

[37]  John K. Tsotsos,et al.  The Roles of Endstopped and Curvature Tuned Computations in a Hierarchical Representation of 2D Shape , 2012, PloS one.

[38]  J. Nelson,et al.  Orientation-selective inhibition from beyond the classic visual receptive field , 1978, Brain Research.

[39]  R. Shapley,et al.  Area (mt) Spatial Summation, End Inhibition and Side Inhibition in the Middle Temporal Visual Adaptation Complex Cells Increase Their Phase Sensitivity at Low Contrasts and following Dependence of Response Properties on Sparse Connectivity in a Spiking Neuron Model Of , 2022 .

[40]  J. A. Hirsch.  Synaptic physiology and receptive field structure in the early visual pathway of the cat. , 2003, Cerebral cortex.

[41]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Keiji Tanaka.  Columns for complex visual object features in the inferotemporal cortex: clustering of cells with similar but slightly different stimulus selectivities. , 2003, Cerebral cortex.

[43]  Nikolay Petkov,et al.  Biologically motivated computationally intensive approaches to image pattern recognition , 1995, Future Gener. Comput. Syst..

[44]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[45]  H. Jones,et al.  Surround suppression in primate V1. , 2001, Journal of neurophysiology.

[46]  Tomaso Poggio,et al.  Models of object recognition , 2000, Nature Neuroscience.

[47]  Y. Frégnac,et al.  Visual input evokes transient and strong shunting inhibition in visual cortical neurons , 1998, Nature.

[48]  D. V. van Essen,et al.  Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. , 1992, Journal of neurophysiology.

[49]  D. Ferster.  Spatially opponent excitation and inhibition in simple cells of the cat visual cortex , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[50]  J. P. Jones,et al.  The two-dimensional spatial structure of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[51]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  R. von der Heydt,et al.  A neural model of figure-ground organization. , 2007, Journal of neurophysiology.

[53]  P. Heggelund.  Receptive field organization of simple cells in cat striate cortex , 1981, Experimental brain research.

[54]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[55]  D. Tolhurst,et al.  Spatial summation by simple cells in the striate cortex of the cat , 2004, Experimental Brain Research.

[56]  G. Rizzolatti,et al.  Inhibition of visual responses of single units in the cat visual area of the lateral suprasylvian gyrus (Clare-Bishop area) by the introduction of a second visual stimulus , 1975, Brain Research.

[57]  P. O. Bishop,et al.  Hypercomplex and simple/complex cell classifications in cat striate cortex. , 1978, Journal of neurophysiology.

[58]  Sinan Kalkan,et al.  Deep Hierarchies in the Primate Visual Cortex: What Can We Learn for Computer Vision? , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  John K. Tsotsos,et al.  The importance of intermediate representations for the modeling of 2D shape detection: Endstopping and curvature tuned computations , 2011, CVPR 2011.

[60]  Li I. Zhang,et al.  Broad Inhibition Sharpens Orientation Selectivity by Expanding Input Dynamic Range in Mouse Simple Cells , 2011, Neuron.