Modeling segmentation of a visual scene via neural oscillators: fragmentation, discovery of details and attention.

The present study analyses the problem of binding and segmentation of a visual scene by means of a network of neural oscillators, laying emphasis on the problems of fragmentation, perception of details at different scales and spatial attention. The work is based on a two-layer model: a second layer of Wilson-Cowan oscillators is inhibited by information from the first layer. Moreover, the model uses a global inhibitor (GI) to segment objects. Spatial attention consists of an excitatory input, surrounded by an inhibitory annulus. A single object is identified by synchronous oscillatory activity of neural groups. The main idea of this work is that segmentation of objects at different detail levels can be achieved by linking parameters of the GI (i.e. the threshold and the inhibition strength) with the dimension of the zone selected by attention and with the dimension of the smaller objects to be detected. Simulations show that three possible kinds of behavior can be attained with the model, through proper choice of the GI parameters and attention input: (i) large objects in the visual scene are perceived, while small details are suppressed; (ii) large objects are perceived, while details are assembled together to constitute a single 'noise term'; (iii) if attention is focused on a smaller area and the GI parameters modulated accordingly (i.e. the threshold and attention strength are reduced) details are individually perceived as separate objects. These results suggest that the GI and attention may represent two concurrent aspects of the same attentive mechanism, i.e. they should work together to provide flexible management of a visual scene at different levels of detail.

[1]  Earl L. Smith,et al.  Transfer characteristics of lateral geniculate nucleus X neurons in the cat: effects of spatial frequency and contrast. , 1995, Journal of neurophysiology.

[2]  DeLiang Wang,et al.  A dynamically coupled neural oscillator network for image segmentation , 2002, Neural Networks.

[3]  John K. Tsotsos,et al.  The selective tuning model of attention: psychophysical evidence for a suppressive annulus around an attended item , 2003, Vision Research.

[4]  S. Grossberg,et al.  Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading. , 1985, Psychological review.

[5]  DeLiang Wang,et al.  Motion segmentation based on motion/brightness integration and oscillatory correlation , 2000, IEEE Trans. Neural Networks Learn. Syst..

[6]  Peter König,et al.  Stimulus-Dependent Assembly Formation of Oscillatory Responses: II. Desynchronization , 1991, Neural Computation.

[7]  Zhaoping Li,et al.  A Neural Model of Contour Integration in the Primary Visual Cortex , 1998, Neural Computation.

[8]  DeLiang Wang,et al.  Range image segmentation using a relaxation oscillator network , 1999, IEEE Trans. Neural Networks.

[9]  S. Yantis,et al.  Transient neural activity in human parietal cortex during spatial attention shifts , 2002, Nature Neuroscience.

[10]  W. Singer Synchronization of cortical activity and its putative role in information processing and learning. , 1993, Annual review of physiology.

[11]  S. Palmer Vision Science : Photons to Phenomenology , 1999 .

[12]  Joachim M. Buhmann,et al.  Sensory segmentation with coupled neural oscillators , 1992, Biological Cybernetics.

[13]  DeLiang Wang,et al.  Image Segmentation Based on Oscillatory Correlation , 1997, Neural Computation.

[14]  Reinhard Eckhorn,et al.  Parallel processing by a homogeneous group of coupled model neurons can enhance, reduce and generate signal correlations , 1997, Biological Cybernetics.

[15]  Hansel,et al.  Synchronization and computation in a chaotic neural network. , 1992, Physical review letters.

[16]  DeLiang Wang,et al.  Synchronization and desynchronization in a network of locally coupled Wilson-Cowan oscillators , 1996, IEEE Trans. Neural Networks.

[17]  H. Schuster,et al.  A model for neuronal oscillations in the visual cortex , 1990, Biological Cybernetics.

[18]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[19]  W. D. Ross,et al.  Visual brain and visual perception: how does the cortex do perceptual grouping? , 1997, Trends in Neurosciences.

[20]  Carl R Olson,et al.  Object-based vision and attention in primates , 2001, Current Opinion in Neurobiology.

[21]  Michael J. Hawken,et al.  Macaque VI neurons can signal ‘illusory’ contours , 1993, Nature.

[22]  DeLiang Wang,et al.  Emergent synchrony in locally coupled neural oscillators , 1995, IEEE Trans. Neural Networks.

[23]  Deliang Wang,et al.  Global competition and local cooperation in a network of neural oscillators , 1995 .

[24]  DeLiang Wang,et al.  Weight adaptation and oscillatory correlation for image segmentation , 2000, IEEE Trans. Neural Networks Learn. Syst..

[25]  D. Somers,et al.  Functional MRI reveals spatially specific attentional modulation in human primary visual cortex. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Reinhard Eckhorn,et al.  Neural mechanisms of scene segmentation: recordings from the visual cortex suggest basic circuits for linking field models , 1999, IEEE Trans. Neural Networks.

[27]  M. Tovée,et al.  Oscillatory activity is not evident in the primate temporal visual cortex with static stimuli , 1992, Neuroreport.

[28]  L. Finkel,et al.  Extraction of perceptually salient contours by striate cortical networks , 1998, Vision Research.

[29]  Peter König,et al.  Stimulus-Dependent Assembly Formation of Oscillatory Responses: I. Synchronization , 1991, Neural Computation.

[30]  C. Enroth-Cugell,et al.  Receptive field properties of X and Y cells in the cat retina derived from contrast sensitivity measurements , 1982, Vision Research.

[31]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[32]  H. Schuster,et al.  A model for neuronal oscillations in the visual cortex , 1990, Biological Cybernetics.

[33]  C. Gilbert,et al.  Improvement in visual sensitivity by changes in local context: Parallel studies in human observers and in V1 of alert monkeys , 1995, Neuron.

[34]  Martha J. Farah,et al.  The Cognitive Neuroscience of Vision , 2000 .

[35]  Alessandro Sarti,et al.  Binding and segmentation of multiple objects through neural oscillators inhibited by contour information , 2003, Biological Cybernetics.

[36]  Christof Koch,et al.  A Simple Network Showing Burst Synchronization without Frequency Locking , 1992, Neural Computation.

[37]  Ch. von der Malsburg,et al.  A neural cocktail-party processor , 1986, Biological Cybernetics.