Sparse and burst spiking in artificial neural networks inspired by synaptic retrograde signaling

Abstract The bursting of action potential and sparse activity are ubiquitously observed in the brain. Although the functions of these activity modes remain to be understood, it is expected that they play a critical role in information processing. In addition, the functional role of retrograde signalling in neural systems is under intensive research. Therefore, we propose a bio-inspired neural network that is capable of demonstrating these activity modes as well as shifting themselves from normal to bursting or sparse modes by changing model parameter values. Accordingly, we model diffused retrograde signalling with different activity patterns in dendrites and presynaptic neurons. Using in a three-layered spiking neural network, simulation studies are conducted using different conditions and parameter values to find factors underlying the change in firing rate of output neurons. Our findings propose the application of retrograde signalling as a known synaptic mechanism for the development of artificial neural systems to encode environmental information by different spiking modes.

[1]  T. Bliss,et al.  Synaptic plasticity in health and disease: introduction and overview , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[2]  Thomas Nowotny,et al.  Burst Firing Enhances Neural Output Correlation , 2016, Front. Comput. Neurosci..

[3]  Faramarz Faghihi,et al.  A computational model of pattern separation efficiency in the dentate gyrus with implications in schizophrenia , 2015, Front. Syst. Neurosci..

[4]  M. Brecht,et al.  Sparse and powerful cortical spikes , 2010, Current Opinion in Neurobiology.

[5]  Dewen Hu,et al.  Retrograde adaptive resonance theory based on the role of nitric oxide in long-term potentiation , 2007, Journal of Computational Neuroscience.

[6]  I. Forsythe,et al.  Nitric Oxide Signaling in Brain Function, Dysfunction, and Dementia , 2010, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[7]  Dianhui Wang,et al.  An iterative learning algorithm for feedforward neural networks with random weights , 2016, Inf. Sci..

[8]  Meng Wang,et al.  Multimodal Deep Autoencoder for Human Pose Recovery , 2015, IEEE Transactions on Image Processing.

[9]  L. Abbott,et al.  Synaptic computation , 2004, Nature.

[10]  Irene Elices,et al.  Asymmetry Factors Shaping Regular and Irregular Bursting Rhythms in Central Pattern Generators , 2017, Front. Comput. Neurosci..

[11]  Ioannis M. Stephanakis,et al.  A novel data preprocessing method for boosting neural network performance: A case study in osteoporosis prediction , 2017, Inf. Sci..

[12]  S. Farris.  Are mushroom bodies cerebellum-like structures? , 2011, Arthropod structure & development.

[13]  Everton J. Agnes,et al.  Diverse synaptic plasticity mechanisms orchestrated to form and retrieve memories in spiking neural networks , 2015, Nature Communications.

[14]  Jacek M. Zurada,et al.  Convergence analyses on sparse feedforward neural networks via group lasso regularization , 2017, Inf. Sci..

[15]  Wolf Singer,et al.  Oscillations and Neuronal Dynamics in Schizophrenia: The Search for Basic Symptoms and Translational Opportunities , 2015, Biological Psychiatry.

[16]  Faramarz Faghihi,et al.  Impaired homeostatic regulation of feedback inhibition associated with system deficiency to detect fluctuation in stimulus intensity: a simulation study , 2015, Neurocomputing.

[17]  M. Kano,et al.  Endocannabinoid-mediated retrograde modulation of synaptic transmission , 2014, Current Opinion in Neurobiology.

[18]  Joel Zylberberg,et al.  Inhibitory Interneurons Decorrelate Excitatory Cells to Drive Sparse Code Formation in a Spiking Model of V1 , 2013, The Journal of Neuroscience.

[19]  W. Mobley,et al.  Traffic at the intersection of neurotrophic factor signaling and neurodegeneration , 2003, Trends in Neurosciences.

[20]  Maurice J. Chacron,et al.  Burst Firing in the Electrosensory System of Gymnotiform Weakly Electric Fish: Mechanisms and Functional Roles , 2016, Front. Comput. Neurosci..

[21]  G. Turrigiano.  Too many cooks? Intrinsic and synaptic homeostatic mechanisms in cortical circuit refinement. , 2011, Annual review of neuroscience.

[22]  Jianping Fan,et al.  iPrivacy: Image Privacy Protection by Identifying Sensitive Objects via Deep Multi-Task Learning , 2017, IEEE Transactions on Information Forensics and Security.

[23]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[24]  Faramarz Faghihi,et al.  The dependence of neuronal encoding efficiency on Hebbian plasticity and homeostatic regulation of neurotransmitter release , 2015, Front. Cell. Neurosci..

[25]  Yingxu Wang.  Cognitive robotics and mathematical engineering , 2015, ICCI*CC.

[26]  Meng Wang,et al.  Image-Based Three-Dimensional Human Pose Recovery by Multiview Locality-Sensitive Sparse Retrieval , 2015, IEEE Transactions on Industrial Electronics.

[27]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[28]  Diano F. Marrone,et al.  Disambiguating the similar: The dentate gyrus and pattern separation , 2012, Behavioural Brain Research.

[29]  Fei Gao,et al.  Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking , 2017, IEEE Transactions on Cybernetics.

[30]  G. Perea,et al.  Endocannabinoids Induce Lateral Long-Term Potentiation of Transmitter Release by Stimulation of Gliotransmission. , 2015, Cerebral cortex.

[31]  Henry Markram,et al.  An Algorithm for Modifying Neurotransmitter Release Probability Based on Pre- and Postsynaptic Spike Timing , 2001, Neural Computation.

[32]  Jochen Triesch,et al.  Synergies Between Intrinsic and Synaptic Plasticity Mechanisms , 2007, Neural Computation.

[33]  Timothy Q Gentner,et al.  Subthreshold membrane responses underlying sparse spiking to natural vocal signals in auditory cortex , 2015, The European journal of neuroscience.

[34]  Sarah M. N. Woolley,et al.  Sparse and Background-Invariant Coding of Vocalizations in Auditory Scenes , 2013, Neuron.

[35]  Emerging Trends in Retrograde Signaling , 2016, Molecular Neurobiology.

[36]  Nikil D. Dutt,et al.  An Efficient Simulation Environment for Modeling Large-Scale Cortical Processing , 2011, Front. Neuroinform..

[37]  D. A. Baxter,et al.  Current- and voltage-clamp recordings and computer simulations of Kenyon cells in the honeybee. , 2004, Journal of neurophysiology.

[38]  A. Gürel,et al.  Nitric oxide as a physiopathological factor in neuropsychiatric disorders. , 2004, In vivo.

[39]  R. Bertram,et al.  Modeling study of the effects of overlapping Ca2+ microdomains on neurotransmitter release. , 1999, Biophysical journal.

[40]  M. Heisenberg.  What do the mushroom bodies do for the insect brain? an introduction. , 1998, Learning & memory.

[41]  D. Ginty,et al.  Long-distance retrograde neurotrophic factor signalling in neurons , 2013, Nature Reviews Neuroscience.

[42]  M. Poo,et al.  Retrograde signaling at central synapses , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[43]  Florentin Wörgötter,et al.  Time scales of memory, learning, and plasticity , 2012, Biological Cybernetics.