Rapid Processing and Unsupervised Learning in a Model of the Cortical Macrocolumn

We study a model of the cortical macrocolumn consisting of a collection of inhibitorily coupled minicolumns. The proposed system overcomes several severe deficits of systems based on single neurons as cerebral functional units, notably limited robustness to damage and unrealistically large computation time. Motivated by neuroanatomical and neurophysiological findings, the utilized dynamics is based on a simple model of a spiking neuron with refractory period, fixed random excitatory interconnection within minicolumns, and instantaneous inhibition within one macrocolumn. A stability analysis of the system's dynamical equations shows that minicolumns can act as monolithic functional units for purposes of critical, fast decisions and learning. Oscillating inhibition (in the gamma frequency range) leads to a phase-coupled population rate code and high sensitivity to small imbalances in minicolumn inputs. Minicolumns are shown to be able to organize their collective inputs without supervision by Hebbian plasticity into selective receptive field shapes, thereby becoming classifiers for input patterns. Using the bars test, we critically compare our system's performance with that of others and demonstrate its ability for distributed neural coding.

[1]  E M Harth,et al.  Dynamics of neural structures. , 1970, Journal of theoretical biology.

[2]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[3]  J. Hopfield,et al.  Computing with neural circuits: a model. , 1986, Science.

[4]  B. Whitsel,et al.  Spatial organization of the peripheral input to area 1 cell columns. I. the detection of ‘segregates’ , 1988, Brain Research Reviews.

[5]  E. G. Jones,et al.  Synapses of double bouquet cells in monkey cerebral cortex visualized by calbindin immunoreactivity , 1989, Brain Research.

[6]  M. Diamond,et al.  Demonstration of discrete place‐defined columns—segregates—in the cat SI , 1990, The Journal of comparative neurology.

[7]  E. G. Jones,et al.  A microcolumnar structure of monkey cerebral cortex revealed by immunocytochemical studies of double bouquet cell axons , 1990, Neuroscience.

[8]  A. Peters,et al.  Neuronal organization in area 17 of cat visual cortex. , 1993, Cerebral cortex.

[9]  J. Deuchars,et al.  Temporal and spatial properties of local circuits in neocortex , 1994, Trends in Neurosciences.

[10]  Jonathan A. Marshall,et al.  Adaptive perceptual pattern recognition by self-organizing neural networks: Context, uncertainty, multiplicity, and scale , 1995, Neural Networks.

[11]  R. Zemel,et al.  Learning sparse multiple cause models , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[12]  Geoffrey E. Hinton,et al.  The "wake-sleep" algorithm for unsupervised neural networks. , 1995, Science.

[13]  S. Nelson,et al.  An emergent model of orientation selectivity in cat visual cortical simple cells , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  Eric Saund,et al.  A Multiple Cause Mixture Model for Unsupervised Learning , 1995, Neural Computation.

[15]  A. Peters,et al.  Myelinated axons and the pyramidal cell modules in monkey primary visual cortex , 1996, The Journal of comparative neurology.

[16]  D. Kelly,et al.  Stimulus-response diversity in local neuronal populations of the cerebral cortex. , 1996, Neuroreport.

[17]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[18]  R W Prager,et al.  Development of low entropy coding in a recurrent network. , 1996, Network.

[19]  Peter Dayan,et al.  A simple algorithm that discovers efficient perceptual codes , 1997 .

[20]  V. Mountcastle.  The columnar organization of the neocortex. , 1997, Brain : a journal of neurology.

[21]  Geoffrey E. Hinton,et al.  Generative models for discovering sparse distributed representations. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[22]  A. Peters,et al.  The organization of double bouquet cells in monkey striate cortex , 1997, Journal of neurocytology.

[23]  A. Peters,et al.  The organization of pyramidal cells in area 18 of the rhesus monkey. , 1997, Cerebral cortex.

[24]  Jean Bullier,et al.  The Timing of Information Transfer in the Visual System , 1997 .

[25]  E Fransén,et al.  A model of cortical associative memory based on a horizontal network of connected columns. , 1998, Network.

[26]  D Charles,et al.  Modelling multiple-cause structure using rectification constraints. , 1998, Network.

[27]  Jürgen Schmidhuber,et al.  Feature Extraction Through LOCOCODE , 1999, Neural Computation.

[28]  J. Lübke,et al.  Columnar Organization of Dendrites and Axons of Single and Synaptically Coupled Excitatory Spiny Neurons in Layer 4 of the Rat Barrel Cortex , 2000, The Journal of Neuroscience.

[29]  G. Elston,et al.  Pyramidal Cells, Patches, and Cortical Columns: a Comparative Study of Infragranular Neurons in TEO, TE, and the Superior Temporal Polysensory Area of the Macaque Monkey , 2000, The Journal of Neuroscience.

[30]  E. G. Jones,et al.  Microcolumns in the cerebral cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[31]  P. Goldman-Rakic,et al.  Coding Specificity in Cortical Microcircuits: A Multiple-Electrode Analysis of Primate Prefrontal Cortex , 2001, The Journal of Neuroscience.

[32]  Randall C. O'Reilly,et al.  Generalization in Interactive Networks: The Benefits of Inhibitory Competition and Hebbian Learning , 2001, Neural Computation.

[33]  Oleg V. Favorov,et al.  Nonlinear dynamical properties of a somatosensory cortical model , 2001, Inf. Sci..

[34]  J. Budd,et al.  Local lateral connectivity of inhibitory clutch cells in layer 4 of cat visual cortex (area 17) , 2001, Experimental Brain Research.

[35]  Martin A. Giese,et al.  Biophysiologically Plausible Implementations of the Maximum Operation , 2002, Neural Computation.

[36]  Glenn C. Turner,et al.  Oscillations and Sparsening of Odor Representations in the Mushroom Body , 2002, Science.

[37]  Rolf P. Würtz,et al.  Macrocolumns as Decision Units , 2002, ICANN.

[38]  Michael W. Spratling,et al.  Preintegration Lateral Inhibition Enhances Unsupervised Learning , 2002, Neural Computation.

[39]  D. Buxhoeveden,et al.  The Minicolumn and Evolution of the Brain , 2002, Brain, Behavior and Evolution.

[40]  Jörg Lücke,et al.  Hierarchical self-organization of minicolumnar receptive fields , 2004, Neural Networks.

[41]  W. Singer,et al.  Phase Sensitivity of Synaptic Modifications in Oscillating Cells of Rat Visual Cortex , 2004, The Journal of Neuroscience.

[42]  Colin Fyfe,et al.  A Neural Network for PCA and Beyond , 1997, Neural Processing Letters.

[43]  Werner Reichardt,et al.  Figure-ground discrimination by relative movement in the visual system of the fly , 2004, Biological Cybernetics.

[44]  P. Földiák,et al.  Forming sparse representations by local anti-Hebbian learning , 1990, Biological Cybernetics.

[45]  J. Cowan,et al.  A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue , 1973, Kybernetik.

[46]  Tomoki Fukai,et al.  A model of cortical memory processing based on columnar organization , 1994, Biological Cybernetics.