Selecting salient objects in real scenes: An oscillatory correlation model

Attention is a critical mechanism for visual scene analysis. By means of attention, it is possible to break down the analysis of a complex scene to the analysis of its parts through a selection process. Empirical studies demonstrate that attentional selection is conducted on visual objects as a whole. We present a neurocomputational model of object-based selection in the framework of oscillatory correlation. By segmenting an input scene and integrating the segments with their conspicuity obtained from a saliency map, the model selects salient objects rather than salient locations. The proposed system is composed of three modules: a saliency map providing saliency values of image locations, image segmentation for breaking the input scene into a set of objects, and object selection which allows one of the objects of the scene to be selected at a time. This object selection system has been applied to real gray-level and color images and the simulation results show the effectiveness of the system.

[1]  C. Koch,et al.  An oscillation-based model for the neuronal basis of attention , 1993, Vision Research.

[2]  Roman Borisyuk,et al.  Object selection by an oscillatory neural network. , 2002, Bio Systems.

[3]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[4]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[6]  H.M. Wechsler,et al.  Digital image processing, 2nd ed. , 1981, Proceedings of the IEEE.

[7]  Refractor.  Vision , 2000, The Lancet.

[8]  Paul H. E. Tiesinga.  Stimulus competition by inhibitory interference , 2006, Neurocomputing.

[9]  R. Desimone,et al.  Modulation of Oscillatory Neuronal Synchronization by Selective Visual Attention , 2001, Science.

[10]  B Julesz,et al.  The speed of attentional shifts in the visual field. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Christoph von der Malsburg,et al.  The Correlation Theory of Brain Function , 1994 .

[12]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[13]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[14]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[15]  Gustavo Deco,et al.  A neurodynamical model for selective visual attention using oscillators , 2001, Neural Networks.

[16]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[17]  Paul Wintz,et al.  Digital image processing (2nd ed.) , 1987 .

[18]  Steven A. Hillyard,et al.  The Role of Spatial Attention in the Selection of Real and Illusory Objects , 2007, The Journal of Neuroscience.

[19]  H. Pashler.  The Psychology of Attention , 1997 .

[20]  Walter J. Jermakowicz,et al.  Neural networks a century after Cajal , 2007, Brain Research Reviews.

[21]  Balth. van der Pol Jun..  LXXXVIII. On “relaxation-oscillations” , 1926 .

[22]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[23]  Roman Borisyuk,et al.  Selective attention model with spiking elements , 2009, Neural Networks.

[24]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[25]  Robert B. Fisher,et al.  Object-based visual attention for computer vision , 2003, Artif. Intell..

[26]  S. Yantis,et al.  Visual attention: control, representation, and time course. , 1997, Annual review of psychology.

[27]  Roman Borisyuk,et al.  Oscillatory model of attention-guided object selection and novelty detection , 2004, Neural Networks.

[28]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[29]  B. Shinn-Cunningham.  Object-based auditory and visual attention , 2008, Trends in Cognitive Sciences.

[30]  DeLiang Wang,et al.  Image Segmentation Based on Oscillatory Correlation , 1997, Neural Computation.

[31]  DeLiang Wang,et al.  Fast numerical integration of relaxation oscillator networks based on singular limit solutions , 1998, IEEE Trans. Neural Networks.

[32]  Deliang Wang,et al.  Global competition and local cooperation in a network of neural oscillators , 1995 .

[33]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[34]  Christof Koch,et al.  Feature combination strategies for saliency-based visual attention systems , 2001, J. Electronic Imaging.

[35]  S. Yantis.  Control of visual attention. , 1998 .

[36]  Angelo Cangelosi,et al.  A neural model of selective attention and object segmentation in the visual scene: An approach based on partial synchronization and star-like architecture of connections , 2009, Neural Networks.

[37]  DeLiang Wang,et al.  Object selection based on oscillatory correlation , 1999, Neural Networks.

[38]  Jean-Jacques E. Slotine,et al.  Visual Grouping by Neural Oscillator Networks , 2009, IEEE Transactions on Neural Networks.

[39]  Arni Kristjansson,et al.  Efficient visual search without top-down or bottom-up guidance , 2005, Perception & psychophysics.

[40]  D. Wang,et al.  The time dimension for scene analysis , 2005, IEEE Transactions on Neural Networks.

[41]  Johan Grasman,et al.  Relaxation Oscillations , 2009, Encyclopedia of Complexity and Systems Science.

[42]  P. S. Lindsey,et al.  Fast numerical integration of relaxation oscillator networks based on singular limit solutions , 1996 .

[43]  A. Revonsuo,et al.  Binding and Consciousness , 1999, Consciousness and Cognition.

[44]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[45]  Ch. von der Malsburg,et al.  A neural cocktail-party processor , 1986, Biological Cybernetics.

[46]  DeLiang Wang,et al.  Scene analysis by integrating primitive segmentation and associative memory , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[47]  Nancy Kanwisher,et al.  fMRI evidence for objects as the units of attentional selection , 1999, Nature.

[48]  Guy J. Brown,et al.  A computational model of auditory selective attention , 2004, IEEE Transactions on Neural Networks.

[49]  S. Yantis.  3 Goal-Directed and Stimulus-Driven Determinants of Attentional Control , 2000 .

[50]  Hyunkyu Lee,et al.  Attentional spreading in object-based attention. , 2008, Journal of experimental psychology. Human perception and performance.

[51]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[52]  Pieter R. Roelfsema,et al.  Object-based attention in the primary visual cortex of the macaque monkey , 1998, Nature.