Intrinsic Plasticity for Natural Competition in Koniocortex-Like Neural Networks

In this paper, we use the neural property known as intrinsic plasticity to develop neural network models that resemble the koniocortex, the fourth layer of sensory cortices. These models evolved from a very basic two-layered neural network to a complex associative koniocortex network. In the initial network, intrinsic and synaptic plasticity govern the shifting of the activation function, and the modification of synaptic weights, respectively. In this first version, competition is forced, so that the most activated neuron is arbitrarily set to one and the others to zero, while in the second, competition occurs naturally due to inhibition between second layer neurons. In the third version of the network, whose architecture is similar to the koniocortex, competition also occurs naturally owing to the interplay between inhibitory interneurons and synaptic and intrinsic plasticity. A more complex associative neural network was developed based on this basic koniocortex-like neural network, capable of dealing with incomplete patterns and ideally suited to operating similarly to a learning vector quantization network. We also discuss the biological plausibility of the networks and their role in a more complex thalamocortical model.

[1]  John R Huguenard,et al.  Barrel Cortex Microcircuits: Thalamocortical Feedforward Inhibition in Spiny Stellate Cells Is Mediated by a Small Number of Fast-Spiking Interneurons , 2006, The Journal of Neuroscience.

[2]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[3]  Richard Granger,et al.  A cortical model of winner-take-all competition via lateral inhibition , 1992, Neural Networks.

[4]  Bard Ermentrout,et al.  Complex dynamics in winner-take-all neural nets with slow inhibition , 1992, Neural Networks.

[5]  M. C. Angulo,et al.  Postsynaptic glutamate receptors and integrative properties of fast-spiking interneurons in the rat neocortex. , 1999, Journal of neurophysiology.

[6]  Karl Zilles,et al.  Functional diversity of layer IV spiny neurons in rat somatosensory cortex: quantitative morphology of electrophysiologically characterized and biocytin labeled cells. , 2004, Cerebral cortex.

[7]  K. Miller,et al.  Synaptic Economics: Competition and Cooperation in Synaptic Plasticity , 1996, Neuron.

[8]  Alexander M Binshtok,et al.  Functionally Distinct NMDA Receptors Mediate Horizontal Connectivity within Layer 4 of Mouse Barrel Cortex , 1998, Neuron.

[9]  W. Singer,et al.  Different voltage-dependent thresholds for inducing long-term depression and long-term potentiation in slices of rat visual cortex , 1990, Nature.

[10]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[11]  Krzysztof J. Cios,et al.  Simulating Vertical and Horizontal Inhibition with Short-Term Dynamics in a Multi-column Multi-Layer Model of neocortex , 2014, Int. J. Neural Syst..

[12]  Suzanna Becker,et al.  Unsupervised Learning Procedures for Neural Networks , 1991, Int. J. Neural Syst..

[13]  Nuno Maçarico da Costa,et al.  How Thalamus Connects to Spiny Stellate Cells in the Cat's Visual Cortex , 2011, The Journal of Neuroscience.

[14]  D. Ferster,et al.  Orientation selectivity of thalamic input to simple cells of cat visual cortex , 1996, Nature.

[15]  Shuai Li,et al.  Selective Positive–Negative Feedback Produces the Winner-Take-All Competition in Recurrent Neural Networks , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[16]  W. Abraham,et al.  Metaplasticity: A new vista across the field of synaptic plasticity , 1997, Progress in Neurobiology.

[17]  Emilio Del-Moral-Hernandez,et al.  A Preliminary Neural Model for Movement Direction Recognition Based on Biologically Plausible Plasticity Rules , 2007, IWINAC.

[18]  Hojjat Adeli,et al.  Improved spiking neural networks for EEG classification and epilepsy and seizure detection , 2007, Integr. Comput. Aided Eng..

[19]  Alan L. Yuille,et al.  A Winner-Take-All Mechanism Based on Presynaptic Inhibition Feedback , 1989, Neural Computation.

[20]  Y. Frégnac,et al.  Visual input evokes transient and strong shunting inhibition in visual cortical neurons , 1998, Nature.

[21]  Kenneth D Miller,et al.  Processing in layer 4 of the neocortical circuit: new insights from visual and somatosensory cortex , 2001, Current Opinion in Neurobiology.

[22]  Hojjat Adeli,et al.  Spiking Neural Networks , 2009, Int. J. Neural Syst..

[23]  Javier Ropero Peláez,et al.  Towards a neural network based therapy for hallucinatory disorders , 2000, Neural Networks.

[24]  Ralf Wessel,et al.  Winner-take-all selection in a neural system with delayed feedback , 2007, Biological Cybernetics.

[25]  Maria V. Sanchez-Vives,et al.  Electrophysiological classes of cat primary visual cortical neurons in vivo as revealed by quantitative analyses. , 2003, Journal of neurophysiology.

[26]  M. Bear,et al.  Metaplasticity: the plasticity of synaptic plasticity , 1996, Trends in Neurosciences.

[27]  Javier Ropero Peláez,et al.  Plato's theory of ideas revisited , 1997, Neural Networks.

[28]  Zhi-Hong Mao,et al.  Dynamics of Winner-Take-All Competition in Recurrent Neural Networks With Lateral Inhibition , 2007, IEEE Transactions on Neural Networks.

[29]  Ricardo Nitrini,et al.  Performance of illiterate and literate nondemented elderly subjects in two tests of long-term memory , 2004, Journal of the International Neuropsychological Society.

[30]  Chi-Ming Chen,et al.  Winner-take-all neural networks using the highest threshold , 2000, IEEE Trans. Neural Networks Learn. Syst..

[31]  Diego Andina,et al.  Do biological synapses perform probabilistic computations? , 2013, Neurocomputing.

[32]  V. E. Okhotin,et al.  Cytophysiology of spiny stellate cells in the striate cortex and their role in the excitatory mechanisms of intracortical synaptic circulation , 2006, Neuroscience and Behavioral Physiology.

[33]  H. K. Hartline,et al.  INHIBITORY INTERACTION OF RECEPTOR UNITS IN THE EYE OF LIMULUS , 1957, The Journal of general physiology.

[34]  Diego Andina,et al.  The Koniocortex-Like Network: A New Biologically Plausible Unsupervised Neural Network , 2015, IWINAC.

[35]  Tomoki Fukai,et al.  A Simple Neural Network Exhibiting Selective Activation of Neuronal Ensembles: From Winner-Take-All to Winners-Share-All , 1997, Neural Computation.

[36]  Niraj S. Desai,et al.  Homeostatic plasticity in the CNS: synaptic and intrinsic forms , 2003, Journal of Physiology-Paris.

[37]  Teuvo Kohonen,et al.  Physiological interpretationm of the self-organizing map algorithm , 1993 .

[38]  J. A. Hirsch Synaptic integration in layer IV of the ferret striate cortex. , 1995, The Journal of physiology.

[39]  F. Ebner,et al.  Experience-dependent plasticity in adult rat barrel cortex. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[40]  Samuel Kaski,et al.  Winner-take-all networks for physiological models of competitive learning , 1994, Neural Networks.

[41]  Ricardo Nitrini,et al.  The abbreviated form of the Brief Cognitive Battery in the diagnosis of dementia in Alzheimer’s disease , 2009, Dementia & neuropsychologia.

[42]  Niraj S. Desai,et al.  Plasticity in the intrinsic excitability of cortical pyramidal neurons , 1999, Nature Neuroscience.