Extraction of salient contours from cluttered scenes

The responses of neurons in the primary visual cortex (V1) to stimulus inside the receptive field (RF) can be markedly modulated by stimuli outside the classical receptive field. The modulation, relying on contextual configurations, yields excitatory and inhibitory activities. The V1 neurons compose a functional network by lateral interactions and accomplish specific visual tasks in a dynamic and flexible fashion. Well-organized structures and conspicuous image locations are more salient and thus can pop out perceptually from the background. The excitatory and inhibitory activities give different visual physiological interpretations to the two kinds of saliencies. A model of contour extraction, inspired by visual cortical mechanisms of perceptual grouping, is presented. We unify the dual processes of spatial facilitation and surround inhibition to extract salient contours from complex scenes, and in this way coherent spatial configurations and region boundaries could stand out from their surround. The proposed method can selectively retain object contours, and meanwhile can dramatically reduce non-meaningful elements resulting from a texture background. This work gives a clear understanding for the roles of the inhibition and facilitation in grouping, and provides a biologically motivated computational strategy for contour extraction in computer vision.

[1]  Qiuming Zhu,et al.  Edge linking by a directional potential function (DPF) , 1996, Image Vis. Comput..

[2]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Jeffrey S. Perry,et al.  Edge co-occurrence in natural images predicts contour grouping performance , 2001, Vision Research.

[4]  Mauro Ursino,et al.  A model of contextual interactions and contour detection in primary visual cortex , 2004, Neural Networks.

[5]  Nicolai Petkov,et al.  Contour detection based on nonclassical receptive field inhibition , 2003, IEEE Trans. Image Process..

[6]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[7]  Gérard G. Medioni,et al.  Inferring global pereeptual contours from local features , 1996, International Journal of Computer Vision.

[8]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[9]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[10]  D. V. van Essen,et al.  Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. , 1992, Journal of neurophysiology.

[11]  W. D. Ross,et al.  Visual brain and visual perception: how does the cortex do perceptual grouping? , 1997, Trends in Neurosciences.

[12]  George G. Coghill,et al.  Text analysis using local energy , 2001, Pattern Recognit..

[13]  I. Kovács Human development of perceptual organization , 2000, Vision Research.

[14]  Leslie G. Ungerleider,et al.  Contextual Modulation in Primary Visual Cortex of Macaques , 2001, The Journal of Neuroscience.

[15]  A. Sillito,et al.  Surround suppression in primate V1. , 2001, Journal of neurophysiology.

[16]  D. Field,et al.  Integration of contours: new insights , 1999, Trends in Cognitive Sciences.

[17]  C. Gilbert,et al.  Spatial distribution of contextual interactions in primary visual cortex and in visual perception. , 2000, Journal of neurophysiology.

[18]  M Stemmler,et al.  Lateral interactions in primary visual cortex: a model bridging physiology and psychophysics. , 1995, Science.

[19]  Nicolai Petkov,et al.  Contour and boundary detection improved by surround suppression of texture edges , 2004, Image Vis. Comput..

[20]  Zhaoping Li,et al.  A Neural Model of Contour Integration in the Primary Visual Cortex , 1998, Neural Computation.

[21]  Chuan Yi Tang,et al.  A 2.|E|-Bit Distributed Algorithm for the Directed Euler Trail Problem , 1993, Inf. Process. Lett..

[22]  A J Simmers,et al.  Deficit of visual contour integration in dyslexia. , 2001, Investigative ophthalmology & visual science.

[23]  Tai Sing Lee,et al.  Computations in the early visual cortex , 2003, Journal of Physiology-Paris.

[24]  H. Tamura,et al.  Inhibition contributes to orientation selectivity in visual cortex of cat , 1988, Nature.

[25]  U. Polat,et al.  Collinear stimuli regulate visual responses depending on cell's contrast threshold , 1998, Nature.

[26]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[27]  D. Heeger,et al.  Measurement and modeling of center-surround suppression and enhancement , 2001, Vision Research.

[28]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[29]  David A. Clausi,et al.  Unsupervised image segmentation using a simple MRF model with a new implementation scheme , 2004, ICPR 2004.

[30]  L. Finkel,et al.  Extraction of perceptually salient contours by striate cortical networks , 1998, Vision Research.

[31]  D. Fitzpatrick,et al.  Orientation Selectivity and the Arrangement of Horizontal Connections in Tree Shrew Striate Cortex , 1997, The Journal of Neuroscience.

[32]  S. Nelson,et al.  An emergent model of orientation selectivity in cat visual cortical simple cells , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  Tianxu Zhang,et al.  Extraction of Salient Contours Via Excitatory-Inhibitory Interactions in the Visual Cortex , 2006, ACCV.

[34]  Jun Wang,et al.  Salient closed boundary extraction with ratio contour , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  M. Sur,et al.  Dynamic properties of recurrent inhibition in primary visual cortex: contrast and orientation dependence of contextual effects. , 2000, Journal of neurophysiology.

[36]  C. Koch,et al.  Recurrent excitation in neocortical circuits , 1995, Science.

[37]  Aly A. Farag,et al.  Edge linking by sequential search , 1995, Pattern Recognit..

[38]  Steven W. Zucker,et al.  Trace Inference, Curvature Consistency, and Curve Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Josée Rivest,et al.  Localizing contours defined by more than one attribute , 1996, Vision Research.