Speed of feedforward and recurrent processing in multilayer networks of integrate-and-fire neurons

The speed of processing in the visual cortical areas can be fast, with for example the latency of neuronal responses increasing by only approximately 10 ms per area in the ventral visual system sequence V1 to V2 to V4 to inferior temporal visual cortex. This has led to the suggestion that rapid visual processing can only be based on the feedforward connections between cortical areas. To test this idea, we investigated the dynamics of information retrieval in multiple layer networks using a four-stage feedforward network modelled with continuous dynamics with integrate-and-fire neurons, and associative synaptic connections between stages with a synaptic time constant of 10 ms. Through the implementation of continuous dynamics, we found latency differences in information retrieval of only 5 ms per layer when local excitation was absent and processing was purely feedforward. However, information latency differences increased significantly when non-associative local excitation was included. We also found that...

[1]  Pieter R. Roelfsema,et al.  Object-based attention in the primary visual cortex of the macaque monkey , 1998, Nature.

[2]  A. Leventhal,et al.  Signal timing across the macaque visual system. , 1998, Journal of neurophysiology.

[3]  Terrence J. Sejnowski,et al.  RAPID STATE SWITCHING IN BALANCED CORTICAL NETWORK MODELS , 1995 .

[4]  E. Rolls,et al.  Neural networks and brain function , 1998 .

[5]  Jean Bullier,et al.  The Timing of Information Transfer in the Visual System , 1997 .

[6]  G Kovács,et al.  Cortical correlate of pattern backward masking. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Alessandro Treves,et al.  Local Neocortical Processing: a Time for Recognition , 1992, Int. J. Neural Syst..

[8]  E. Rolls,et al.  The Neurophysiology of Backward Visual Masking: Information Analysis , 1999, Journal of Cognitive Neuroscience.

[9]  G. Parisi.  A memory which forgets , 1986 .

[10]  E T Rolls,et al.  Information about spatial view in an ensemble of primate hippocampal cells. , 1998, Journal of neurophysiology.

[11]  A. Treves.  Mean-field analysis of neuronal spike dynamics , 1993 .

[12]  T. Poggio,et al.  Are Cortical Models Really Bound by the “Binding Problem”? , 1999, Neuron.

[13]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[14]  J. Bullier,et al.  Parallel versus serial processing: new vistas on the distributed organization of the visual system , 1995, Current Opinion in Neurobiology.

[15]  Kenji Kawano,et al.  Global and fine information coded by single neurons in the temporal visual cortex , 1999, Nature.

[16]  Wulfram Gerstner,et al.  Population Dynamics of Spiking Neurons: Fast Transients, Asynchronous States, and Locking , 2000, Neural Computation.

[17]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[18]  P. Fldik,et al.  The Speed of Sight , 2001, Journal of Cognitive Neuroscience.

[19]  David I. Perrett,et al.  Modeling visual recognition from neurobiological constraints , 1994, Neural Networks.

[20]  Stefano Panzeri,et al.  On Decoding the Responses of a Population of Neurons from Short Time Windows , 1999, Neural Computation.

[21]  S. Thorpe,et al.  Dynamics of orientation coding in area V1 of the awake primate , 1993, Visual Neuroscience.

[22]  Michael I. Jordan.  An introduction to linear algebra in parallel distributed processing , 1986 .

[23]  M. Tovée,et al.  Information encoding and the responses of single neurons in the primate temporal visual cortex. , 1993, Journal of neurophysiology.

[24]  Stefano Panzeri,et al.  Analytical estimates of limited sampling biases in different information measures. , 1996, Network.

[25]  D. Perrett,et al.  Time course of neural responses discriminating different views of the face and head. , 1992, Journal of neurophysiology.

[26]  M P Young,et al.  Indeterminate Organization of the Visual System , 1996, Science.

[27]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[28]  E. Rolls,et al.  Functional subdivisions of the temporal lobe neocortex , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  L. F. Abbott,et al.  Realistic synaptic inputs for model neural networks , 1991 .

[30]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[31]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[32]  Alessandro Treves,et al.  Stable and Rapid Recurrent Processing in Realistic Autoassociative Memories , 1998, Neural Computation.