Conditions for noise reduction and stable encoding of spatial structure by cortical neural networks

Abstract. Cortical circuits have been proposed to encode information by forming stable spatially structured attractors. Experimentally in the primary somatosensory cortex of the monkey, temporally invariant stimuli lead to spatially structured activity patterns. The purpose of this work is to study a recurrent cortical neural network model with lateral inhibition and examine what effect additive random noise has on the networks' ability to form stable spatially structured representations of the stimulus pattern. We show numerically that this network performs edge enhancement and forms statistically stationary, spatially structured responses when the lateral inhibition is of moderate strength. We then derive analytical conditions on the connectivity matrix that ensure stochasticly stable encoding of the stimulus spatial structure by the network. For stimuli whose strength falls in the near linear region of the sigmoid, we are able to give explicit conditions on the eigenvalues of the connection matrix. Finally, we prove that a network with a connection matrix, where the total excitation and inhibition impinging upon a neural unit are nearly balanced, will yield stable spatial attractor responses.

[1]  H. Schwarz Numerical analysis of symmetric matrices , 1974 .

[2]  S. Amari,et al.  Existence and stability of local excitations in homogeneous neural fields , 1979, Journal of mathematical biology.

[3]  B L Whitsel,et al.  Patterns of increased metabolic activity in somatosensory cortex of monkeys Macaca fascicularis, subjected to controlled cutaneous stimulation: a 2-deoxyglucose study. , 1981, Journal of neurophysiology.

[4]  G. Ermentrout Asymptotic Behavior of Stationary Homogeneous Neuronal Nets , 1982 .

[5]  Stephen Grossberg,et al.  Absolute stability of global pattern formation and parallel memory storage by competitive neural networks , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  L C Katz,et al.  Local circuitry of identified projection neurons in cat visual cortex brain slices , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  S. Zacks,et al.  Introduction to stochastic differential equations , 1988 .

[8]  Douglas G. Kelly,et al.  Contractive nonlinear neural networks: Stability and spatial frequencies , 1988 .

[9]  R. Westervelt,et al.  Stability of analog neural networks with delay. , 1989, Physical review. A, General physics.

[10]  Shihab A. Shamma Spatial and temporal processing in central auditory networks , 1989 .

[11]  D. Kelly,et al.  Stability in contractive nonlinear neural networks , 1990, IEEE Transactions on Biomedical Engineering.

[12]  E. G. Jones,et al.  A microcolumnar structure of monkey cerebral cortex revealed by immunocytochemical studies of double bouquet cell axons , 1990, Neuroscience.

[13]  K. Stratford,et al.  Synaptic transmission between individual pyramidal neurons of the rat visual cortex in vitro , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  J. DeFelipe,et al.  The pyramidal neuron of the cerebral cortex: Morphological and chemical characteristics of the synaptic inputs , 1992, Progress in Neurobiology.

[15]  K. Purpura,et al.  Response variability in retinal ganglion cells of primates. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[16]  J. Lund,et al.  Local circuit neurons of developing and mature macaque prefrontal cortex: Golgi and immunocytochemical characteristics , 1993, The Journal of comparative neurology.

[17]  J. B. Levitt,et al.  Topography of pyramidal neuron intrinsic connections in macaque monkey prefrontal cortex (areas 9 and 46) , 1993, The Journal of comparative neurology.

[18]  J. Deuchars,et al.  Temporal and spatial properties of local circuits in neocortex , 1994, Trends in Neurosciences.

[19]  Luigi M. Ricciardi,et al.  Diffusion Models of Single Neurones' Activity , 1994 .

[20]  Charles E. Smith,et al.  On the Stochastic Stability of a Neural Network Model of Somatosensory Information Processing , 1995 .

[21]  Jack D. Cowan,et al.  Stochastic Single Neurons , 1995, Neural Computation.

[22]  C. Koch,et al.  Recurrent excitation in neocortical circuits , 1995, Science.

[23]  William R. Softky,et al.  Comparison of discharge variability in vitro and in vivo in cat visual cortex neurons. , 1996, Journal of neurophysiology.

[24]  A. Grinvald,et al.  Dynamics of Ongoing Activity: Explanation of the Large Variability in Evoked Cortical Responses , 1996, Science.

[25]  B. Knight,et al.  Response variability and timing precision of neuronal spike trains in vivo. , 1997, Journal of neurophysiology.

[26]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[27]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[28]  B. Ermentrout Neural networks as spatio-temporal pattern-forming systems , 1998 .