Feedback Enhances Feedforward Figure-Ground Segmentation by Changing Firing Mode

In the visual cortex, feedback projections are conjectured to be crucial in figure-ground segregation. However, the precise function of feedback herein is unclear. Here we tested a hypothetical model of reentrant feedback. We used a previous developed 2-layered feedforwardspiking network that is able to segregate figure from ground and included feedback connections. Our computer model data show that without feedback, neurons respond with regular low-frequency (∼9 Hz) bursting to a figure-ground stimulus. After including feedback the firing pattern changed into a regular (tonic) spiking pattern. In this state, we found an extra enhancement of figure responses and a further suppression of background responses resulting in a stronger figure-ground signal. Such push-pull effect was confirmed by comparing the figure-ground responses withthe responses to a homogenous texture. We propose that feedback controlsfigure-ground segregation by influencing the neural firing patterns of feedforward projecting neurons.

[1]  Johannes J. Fahrenfort,et al.  Feedforward and Recurrent Processing in Scene Segmentation: Electroencephalography and Functional Magnetic Resonance Imaging , 2008, Journal of Cognitive Neuroscience.

[2]  H. Spekreijse,et al.  Synchrony dynamics in monkey V1 predict success in visual detection. , 2006, Cerebral cortex.

[3]  R. Llinás,et al.  Bursting of thalamic neurons and states of vigilance. , 2006, Journal of neurophysiology.

[4]  Victor A. F. Lamme,et al.  Source (or Part of the following Source): Type Article Title Internal State of Monkey Primary Visual Cortex (v1) Predicts Figure Ground Perception Author(s) Internal State of Monkey Primary Visual Cortex (v1) Predicts Figure–ground Perception Materials and Methods , 2022 .

[5]  Li Zhaoping,et al.  Border Ownership from Intracortical Interactions in Visual Area V2 , 2005, Neuron.

[6]  R. Wurtz,et al.  Guarding the gateway to cortex: attention in visual thalamus , 2008, Nature.

[7]  G. L. Masson,et al.  Feedback inhibition controls spike transfer in hybrid thalamic circuits , 2002, Nature.

[8]  A. Sillito,et al.  Corticothalamic feedback enhances stimulus response precision in the visual system , 2007, Proceedings of the National Academy of Sciences.

[9]  Hans Supèr,et al.  Feed-Forward Segmentation of Figure-Ground and Assignment of Border-Ownership , 2010, PloS one.

[10]  S. Sherman.  Tonic and burst firing: dual modes of thalamocortical relay , 2001, Trends in Neurosciences.

[11]  S. Grossberg.  Towards a unified theory of neocortex: laminar cortical circuits for vision and cognition. , 2007, Progress in brain research.

[12]  H. Spekreijse,et al.  Masking Interrupts Figure-Ground Signals in V1 , 2002, Journal of Cognitive Neuroscience.

[13]  G Tononi,et al.  Modeling perceptual grouping and figure-ground segregation by means of active reentrant connections. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Pieter R. Roelfsema,et al.  Different Processing Phases for Features, Figures, and Selective Attention in the Primary Visual Cortex , 2007, Neuron.

[15]  Thomas Wachtler,et al.  Coding the presence of visual objects in a recurrent neural network of visual cortex , 2007, Biosyst..

[16]  Victor A. F. Lamme,et al.  The influence of inattention on the neural correlates of scene segmentation , 2006, Brain Research.

[17]  W. Merigan,et al.  Mechanisms of Sensitivity Loss due to Visual Cortex Lesions in Humans and Macaques. , 2006, Cerebral cortex.

[18]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[19]  Lawrence C. Sincich,et al.  Oriented Axon Projections in Primary Visual Cortex of the Monkey , 2001, The Journal of Neuroscience.

[20]  R. von der Heydt,et al.  A neural model of figure-ground organization. , 2007, Journal of neurophysiology.

[21]  T. Lee,et al.  The role of early visual cortex in visual integration: a neural model of recurrent interaction , 2004, The European journal of neuroscience.

[22]  A. Sillito,et al.  Always returning: feedback and sensory processing in visual cortex and thalamus , 2006, Trends in Neurosciences.

[23]  P Girard,et al.  Feedback connections act on the early part of the responses in monkey visual cortex. , 2001, Journal of neurophysiology.

[24]  M. Paradiso,et al.  Neural Correlates of Perceived Brightness in the Retina, Lateral Geniculate Nucleus, and Striate Cortex , 1999, The Journal of Neuroscience.

[25]  Alain Destexhe,et al.  The initiation of bursts in thalamic neurons and the cortical control of thalamic sensitivity. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[26]  S. Grossberg,et al.  A neural model of how horizontal and interlaminar connections of visual cortex develop into adult circuits that carry out perceptual grouping and learning. , 2010, Cerebral cortex.

[27]  A. Cowey,et al.  Striate cortex (V1) activity gates awareness of motion , 2005, Nature Neuroscience.

[28]  H. Spekreijse,et al.  Set Size Effects in the Macaque Striate Cortex , 2003, Journal of Cognitive Neuroscience.

[29]  C Alain,et al.  Attentional set modulates visual areas: an event-related potential study of attentional capture. , 2001, Brain research. Cognitive brain research.

[30]  Stephen A. Baccus,et al.  Segregation of object and background motion in the retina , 2003, Nature.

[31]  Hans Supèr,et al.  Rebound Spiking as a Neural Mechanism for Surface Filling-in , 2011, Journal of Cognitive Neuroscience.

[32]  P. Sajda,et al.  Inferring figure-ground using a recurrent integrate-and-fire neural circuit , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Ko Sakai,et al.  Spatial attention in early vision for the perception of border ownership. , 2008, Journal of vision.

[34]  Christian M Kerskens,et al.  Reduced BOLD response to periodic visual stimulation , 2004, NeuroImage.

[35]  R. von der Heydt,et al.  Analysis of the Context Integration Mechanisms Underlying Figure–Ground Organization in the Visual Cortex , 2010, The Journal of Neuroscience.

[36]  J. Bullier,et al.  Response modulations by static texture surround in area V1 of the macaque monkey do not depend on feedback connections from V2. , 2001, Journal of neurophysiology.

[37]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[38]  Heiko Neumann,et al.  Ventral extra-striate cortical areas are required for human visual texture segmentation. , 2009, Journal of vision.

[39]  Pieter R. Roelfsema,et al.  Boundary assignment in a recurrent network architecture , 2007, Vision Research.

[40]  Fraser W. Smith,et al.  Nonstimulated early visual areas carry information about surrounding context , 2010, Proceedings of the National Academy of Sciences.

[41]  Laurie M Wilcox,et al.  A reevaluation of the tolerance to vertical misalignment in stereopsis. , 2009, Journal of vision.

[42]  C. Brunia,et al.  Anticipatory attention: an event-related desynchronization approach. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[43]  Victor A. F. Lamme,et al.  Altered figure-ground perception in monkeys with an extra-striate lesion , 2007, Neuropsychologia.

[44]  F. van der Velde,et al.  From Knowing What to Knowing Where: Modeling Object-Based Attention with Feedback Disinhibition of Activation , 2001, Journal of Cognitive Neuroscience.

[45]  F. Velde,et al.  From Knowing What to Knowing Where: Modeling Object-Based Attention with Feedback Disinhibition of Activation , 2001 .

[46]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[47]  J. B. Levitt,et al.  Circuits for Local and Global Signal Integration in Primary Visual Cortex , 2002, The Journal of Neuroscience.

[48]  Bogdan Dreher,et al.  The effects of reversible inactivation of postero-temporal visual cortex on neuronal activities in cat's area 17 , 2007, Brain Research.

[49]  Haijian Sun,et al.  A neurocomputational model of figure-ground discrimination and target tracking , 1999, IEEE Trans. Neural Networks.

[50]  A. Sillito,et al.  Surround suppression in primate V1. , 2001, Journal of neurophysiology.

[51]  H. Spekreijse,et al.  Two distinct modes of sensory processing observed in monkey primary visual cortex (V1) , 2001, Nature Neuroscience.

[52]  F. Qiu,et al.  Figure-ground mechanisms provide structure for selective attention , 2007, Nature Neuroscience.

[53]  Heiko Wersing,et al.  A Competitive-Layer Model for Feature Binding and Sensory Segmentation , 2001, Neural Computation.

[54]  W. Guido,et al.  Burst and tonic response modes in thalamic neurons during sleep and wakefulness. , 2001, Journal of neurophysiology.

[55]  E. Vogel,et al.  The visual N1 component as an index of a discrimination process. , 2000, Psychophysiology.

[56]  A. Thielscher,et al.  Neural mechanisms of cortico–cortical interaction in texture boundary detection: a modeling approach , 2003, Neuroscience.

[57]  Mark Hallett,et al.  Two periods of processing in the (circum)striate visual cortex as revealed by transcranial magnetic stimulation , 1998, Neuropsychologia.

[58]  T. Sejnowski,et al.  Thalamocortical oscillations in the sleeping and aroused brain. , 1993, Science.

[59]  Drazen Domijan,et al.  A feedback model of figure-ground assignment. , 2008, Journal of vision.

[60]  J. Budd.  Extrastriate feedback to primary visual cortex in primates: a quantitative analysis of connectivity , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[61]  Erratum: Loss of attentional stimulus selection after extrastriate cortical lesions in macaques , 2000, Nature neuroscience.

[62]  S. Grossberg,et al.  Texture segregation by visual cortex: Perceptual grouping, attention, and learning , 2007, Vision Research.

[63]  Victor A. F. Lamme,et al.  Figure–ground activity in primary visual cortex (V1) of the monkey matches the speed of behavioral response , 2003, Neuroscience Letters.

[64]  H. Spekreijse,et al.  FigureGround Segregation in a Recurrent Network Architecture , 2002, Journal of Cognitive Neuroscience.

[65]  Á. Pascual-Leone,et al.  Fast Backprojections from the Motion to the Primary Visual Area Necessary for Visual Awareness , 2001, Science.