Enhancement of Perceptually Salient Contours using a Parallel Artificial Cortical Network

In this paper we present a parallel artificial cortical network inspired by the Human visual system, which enhances the salient contours of an image. The network consists of independent processing elements, which are organized into hypercolumns. They process concurrently the distinct orientations of all the edges of the image. These processing elements are a new set of orientation kernels appropriate for the discrete lattice of the hypercolumns. The Gestalt laws of proximity and continuity that describe the process of saliency extraction in the human brain are encoded by means of weights. These weights interconnect the kernels according to a novel connection pattern based on co-exponentiality. The output of every kernel is modulated by the outputs of its neighboring kernels, according to a new affinity function. This function takes into account the degree of difference between the facilitation of the two lobes of the kernel. Saliency enhancement results as a consequence of the local interactions between the kernels. The network was tested on real and synthetic images and displays promising results for both. Comparisons with other methods with the same scope, demonstrate that the proposed method performs adequately. Furthermore it exhibits O(N) complexity with execution times that have never been reported by any other method so far, even though it is executed on a conventional PC

[1]  K. H. Britten,et al.  Neuronal correlates of a perceptual decision , 1989, Nature.

[2]  C. Gilbert,et al.  Spatial integration and cortical dynamics. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Sudeep Sarkar,et al.  An In-Depth Study of Graph Partitioning Measures for Perceptual Organization , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  I Kovács,et al.  A closed curve is much more than an incomplete one: effect of closure in figure-ground segmentation. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[6]  J. Lund,et al.  Intrinsic laminar lattice connections in primate visual cortex , 1983, The Journal of comparative neurology.

[7]  Suzanne P. McKee,et al.  Constraints on long range interactions mediating contour detection , 1998, Vision Research.

[8]  Laurent Itti,et al.  Computational modeling and exploration of contour integration for visual saliency , 2005, Biological Cybernetics.

[9]  Radu Horaud,et al.  Figure-Ground Discrimination: A Combinatorial Optimization Approach , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  J. Braun On the detection of salient contours. , 1999, Spatial vision.

[11]  Jeffrey S. Perry,et al.  Edge co-occurrence in natural images predicts contour grouping performance , 2001, Vision Research.

[12]  Richard A. Young,et al.  Physiological model of motion analysis for machine vision , 1993, Electronic Imaging.

[13]  Laurent Itti,et al.  A Model of Contour Integration in Early Visual Cortex , 2002, Biologically Motivated Computer Vision.

[14]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Laurent Itti,et al.  CINNIC, a new computational algorithm for the modeling of early visual contour integration in humans , 2003, Neurocomputing.

[16]  Risto Miikkulainen,et al.  Contour integration and segmentation with self-organized lateral connections , 2004, Biological Cybernetics.

[17]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[18]  L. Finkel,et al.  Extraction of perceptually salient contours by striate cortical networks , 1998, Vision Research.

[19]  S Grossberg,et al.  3-D vision and figure-ground separation by visual cortex , 2010, Perception & psychophysics.

[20]  Leif H. Finkel,et al.  Salient Contour Extraction by Temporal Binding in a Cortically-based Network , 1996, NIPS.

[21]  Lawrence C. Sincich,et al.  Oriented Axon Projections in Primary Visual Cortex of the Monkey , 2001, The Journal of Neuroscience.

[22]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[23]  Leif H. Finkel,et al.  Cortical synchronization and perceptual salience , 1998 .

[24]  R A Young,et al.  The Gaussian derivative model for spatial vision: I. Retinal mechanisms. , 1988, Spatial vision.

[25]  C. Gilbert,et al.  Improvement in visual sensitivity by changes in local context: Parallel studies in human observers and in V1 of alert monkeys , 1995, Neuron.

[26]  Stephen Grossberg,et al.  Synthetic aperture radar processing by a multiple scale neural system for boundary and surface representation , 1995, Neural Networks.

[27]  D H HUBEL,et al.  RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT. , 1965, Journal of neurophysiology.

[28]  Zhaoping Li,et al.  A Neural Model of Contour Integration in the Primary Visual Cortex , 1998, Neural Computation.

[29]  Steven W. Zucker,et al.  Trace Inference, Curvature Consistency, and Curve Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  C. Gilbert,et al.  Spatial distribution of contextual interactions in primary visual cortex and in visual perception. , 2000, Journal of neurophysiology.

[31]  Ennio Mingolla,et al.  Recent progress in modeling neural mechanisms of form and color vision , 1998, Image Vis. Comput..

[32]  Lance R. Williams,et al.  A Comparison of Measures for Detecting Natural Shapes in Cluttered Backgrounds , 1998, International Journal of Computer Vision.

[33]  Pietro Perona Steerable-scalable kernels for edge detection and junction analysis , 1992, Image Vis. Comput..

[34]  R. F Hess,et al.  Contour integration and cortical processing , 2003, Journal of Physiology-Paris.

[35]  Ennio Mingolla,et al.  Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations , 1985 .

[36]  Ohad Ben-Shahar,et al.  Cortical connections and early visual function: intra- and inter-columnar processing , 2003, Journal of Physiology-Paris.

[37]  U. Polat,et al.  Collinear stimuli regulate visual responses depending on cell's contrast threshold , 1998, Nature.

[38]  Ronen Basri,et al.  Extracting Salient Curves from Images: An Analysis of the Saliency Network , 2004, International Journal of Computer Vision.

[39]  B. Julesz,et al.  Perceptual sensitivity maps within globally defined visual shapes , 1994, Nature.

[40]  Jun Wang,et al.  Salient closed boundary extraction with ratio contour , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Lance R. Williams,et al.  Segmentation of Multiple Salient Closed Contours from Real Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  D. Fitzpatrick The functional organization of local circuits in visual cortex: insights from the study of tree shrew striate cortex. , 1996, Cerebral cortex.

[43]  S. Maier,et al.  Widespread Periodic Intrinsic Connections in the Tree Shrew Visual Cortex , 2005 .

[44]  Scott N. J. Watamaniuk,et al.  Temporal and spatial integration in dynamic random-dot stimuli , 1992, Vision Research.

[45]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.