Brain-Inspired SNN for Deep Learning in Time-Space and Deep Knowledge Representation. NeuCube

This chapter introduces brain-inspired evolving SNN (BI-SNN) in which both the SNN architecture and learning are inspired by the structure, organisation and learning in the human brain. BI-SNN manifest deep learning from data and deep knowledge representation inspired by human brain as discussed in Chap. 3 of the book. In BI-SNN data is represented as spikes, information is represented as spatio-temporal spike patterns and deep knowledge is represented as patterns of connections that are subject to deep learning and can be interpreted by humans.

[1]  Erkki Oja,et al.  Visual feature analysis by the self-organising maps , 1998, Neural Computing & Applications.

[2]  Nikola Kasabov,et al.  Evolving Connectionist Systems: The Knowledge Engineering Approach , 2007 .

[3]  S. Thorpe,et al.  Spike Timing Dependent Plasticity Finds the Start of Repeating Patterns in Continuous Spike Trains , 2008, PloS one.

[4]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Sander M. Bohte,et al.  The evidence for neural information processing with precise spike-times: A survey , 2004, Natural Computing.

[6]  Nikola Kasabov,et al.  Dynamic evolving spiking neural networks for on-line spatio- and spectro-temporal pattern recognition. , 2013, Neural networks : the official journal of the International Neural Network Society.

[7]  Nikola Kasabov,et al.  Modelling Peri-Perceptual Brain Processes in a Deep Learning Spiking Neural Network Architecture , 2018, Scientific Reports.

[8]  Nikola K. Kasabov,et al.  Evolving Connectionist Systems: From Neuro-Fuzzy-, to Spiking- and Neuro-Genetic , 2015, Handbook of Computational Intelligence.

[9]  Maryam Gholami Doborjeh,et al.  Evolving, dynamic clustering of spatio/spectro-temporal data in 3D spiking neural network models and a case study on EEG data , 2018, Evol. Syst..

[10]  Yuji Ikegaya,et al.  Synfire Chains and Cortical Songs: Temporal Modules of Cortical Activity , 2004, Science.

[11]  Jie Yang,et al.  Mapping Temporal Variables Into the NeuCube for Improved Pattern Recognition, Predictive Modeling, and Understanding of Stream Data , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Muhaini Othman,et al.  Evolving spiking neural networks for personalised modelling, classification and prediction of spatio-temporal patterns with a case study on stroke , 2014, Neurocomputing.

[13]  Nikola K. Kasabov,et al.  EEG Classification with BSA Spike Encoding Algorithm and Evolving Probabilistic Spiking Neural Network , 2011, ICONIP.

[14]  Jeff Shrager,et al.  Observation of Phase Transitions in Spreading Activation Networks , 1987, Science.

[15]  Jacques Gautrais,et al.  Rank order coding , 1998 .

[16]  Maryam Gholami Doborjeh,et al.  Evolving spatio-temporal data machines based on the NeuCube neuromorphic framework: Design methodology and selected applications , 2016, Neural Networks.

[17]  Nikola Kasabov,et al.  New Algorithms for Encoding, Learning and Classification of fMRI Data in a Spiking Neural Network Architecture: A Case on Modeling and Understanding of Dynamic Cognitive Processes , 2017, IEEE Transactions on Cognitive and Developmental Systems.

[18]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[19]  Stefan Schliebs,et al.  Span: Spike Pattern Association Neuron for Learning Spatio-Temporal Spike Patterns , 2012, Int. J. Neural Syst..

[20]  Giacomo Indiveri,et al.  Online spatio-temporal pattern recognition with evolving spiking neural networks utilising address event representation, rank order, and temporal spike learning , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[21]  Bernhard Hellwig,et al.  A quantitative analysis of the local connectivity between pyramidal neurons in layers 2/3 of the rat visual cortex , 2000, Biological Cybernetics.

[22]  Nikola K. Kasabov,et al.  NeuCube: A spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data , 2014, Neural Networks.

[23]  Nikola K. Kasabov,et al.  Spiking neural network methodology for modelling, classification and understanding of EEG spatio-temporal data measuring cognitive processes , 2015, Inf. Sci..

[24]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[25]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[26]  Pragya Agarwal,et al.  Self-Organising Maps , 2008 .

[27]  Marc M. Van Hulle,et al.  Enhancing the Yield of High-Density electrode Arrays through Automated electrode Selection , 2012, Int. J. Neural Syst..

[28]  T. Delbruck,et al.  A 64x64 aer logarithmic temporal derivative silicon retina , 2005, Research in Microelectronics and Electronics, 2005 PhD.

[29]  Nikola Kasabov,et al.  Foundations Of Neural Networks, Fuzzy Systems, And Knowledge Engineering [Books in Brief] , 1996, IEEE Transactions on Neural Networks.

[30]  Tobi Delbrück,et al.  Fast sensory motor control based on event-based hybrid neuromorphic-procedural system , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[31]  Alan C. Evans,et al.  Revealing modular architecture of human brain structural networks by using cortical thickness from MRI. , 2008, Cerebral cortex.

[32]  Nikola K. Kasabov,et al.  NeuCube EvoSpike Architecture for Spatio-temporal Modelling and Pattern Recognition of Brain Signals , 2012, ANNPR.

[33]  Stefan Marks.  Immersive visualisation of 3-dimensional spiking neural networks , 2017, Evol. Syst..