Evolving spatio-temporal data machines based on the NeuCube neuromorphic framework: Design methodology and selected applications

The paper describes a new type of evolving connectionist systems (ECOS) called evolving spatio-temporal data machines based on neuromorphic, brain-like information processing principles (eSTDM). These are multi-modular computer systems designed to deal with large and fast spatio/spectro temporal data using spiking neural networks (SNN) as major processing modules. ECOS and eSTDM in particular can learn incrementally from data streams, can include 'on the fly' new input variables, new output class labels or regression outputs, can continuously adapt their structure and functionality, can be visualised and interpreted for new knowledge discovery and for a better understanding of the data and the processes that generated it. eSTDM can be used for early event prediction due to the ability of the SNN to spike early, before whole input vectors (they were trained on) are presented. A framework for building eSTDM called NeuCube along with a design methodology for building eSTDM using this is presented. The implementation of this framework in MATLAB, Java, and PyNN (Python) is presented. The latter facilitates the use of neuromorphic hardware platforms to run the eSTDM. Selected examples are given of eSTDM for pattern recognition and early event prediction on EEG data, fMRI data, multisensory seismic data, ecological data, climate data, audio-visual data. Future directions are discussed, including extension of the NeuCube framework for building neurogenetic eSTDM and also new applications of eSTDM.

[1]  Markus Diesmann,et al.  Towards the Visualization of Spiking Neurons in Virtual Reality , 2011, MMVR.

[2]  Snjezana Soltic,et al.  Knowledge Extraction from Evolving Spiking Neural Networks with Rank Order Population Coding , 2010, Int. J. Neural Syst..

[3]  Nikola Kasabov,et al.  A Feasibility Study of Using the NeuCube Spiking Neural Network Architecture for Modelling Alzheimer's Disease EEG Data , 2015, Advances in Neural Networks.

[4]  Dimitar Filev,et al.  Generation of Fuzzy Rules by Mountain Clustering , 1994, J. Intell. Fuzzy Syst..

[5]  M. Torrens.  Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[6]  Pierre Yger,et al.  PyNN: A Common Interface for Neuronal Network Simulators , 2008, Front. Neuroinform..

[7]  Nikola K. Kasabov,et al.  Incremental learning algorithm for spatio-temporal spike pattern classification , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[8]  Jin Hu,et al.  Improved predictive personalized modelling with the use of Spiking Neural Network system and a case study on stroke occurrences data , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[9]  Tom M. Mitchell,et al.  Classifying Instantaneous Cognitive States from fMRI Data , 2003, AMIA.

[10]  Michael Defoin-Platel,et al.  Quantum-Inspired Evolutionary Algorithm: A Multimodel EDA , 2009, IEEE Transactions on Evolutionary Computation.

[11]  Nikola Kasabov,et al.  Dynamic evolving spiking neural networks for on-line spatio- and spectro-temporal pattern recognition. , 2013, Neural networks : the official journal of the International Neural Network Society.

[12]  Nikola K. Kasabov,et al.  NeuCube: A spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data , 2014, Neural Networks.

[13]  Stefan Bruckner,et al.  BrainGazer - Visual Queries for Neurobiology Research , 2009, IEEE Transactions on Visualization and Computer Graphics.

[14]  Jin Hu,et al.  Spatio-temporal EEG Data Classification in the NeuCube 3D SNN Environment: Methodology and Examples , 2013, ICONIP.

[15]  Archan Misra,et al.  TODMIS: mining communities from trajectories , 2013, CIKM.

[16]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[17]  Benjamin Schrauwen,et al.  An experimental unification of reservoir computing methods , 2007, Neural Networks.

[18]  Jin Hu,et al.  Feasibility of NeuCube SNN architecture for detecting motor execution and motor intention for use in BCIapplications , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[19]  Nikola Kasabov,et al.  Computational Neurogenetic Modeling , 2007 .

[20]  Ramayya Krishnan,et al.  Understanding Sequential Decisions via Inverse Reinforcement Learning , 2013, 2013 IEEE 14th International Conference on Mobile Data Management.

[21]  Muhaini Othman,et al.  Evolving spiking neural networks for personalised modelling, classification and prediction of spatio-temporal patterns with a case study on stroke , 2014, Neurocomputing.

[22]  Arnaud Delorme,et al.  Spike-based strategies for rapid processing , 2001, Neural Networks.

[23]  Karthikeyan Sankaralingam,et al.  Dark Silicon and the End of Multicore Scaling , 2012, IEEE Micro.

[24]  Sheng-Chuan Wang,et al.  The Neuron Navigator: Exploring the information pathway through the neural maze , 2011, 2011 IEEE Pacific Visualization Symposium.

[25]  Simei Gomes Wysoski,et al.  Evolving spiking neural networks for audiovisual information processing , 2010, Neural Networks.

[26]  Giacomo Indiveri,et al.  NeuCube Neuromorphic Framework for Spatio-temporal Brain Data and Its Python Implementation , 2013, ICONIP.

[27]  Nikola Kasabov,et al.  Evolving Connectionist Systems: The Knowledge Engineering Approach , 2007 .

[28]  Susan P. Worner,et al.  Extracting temporal knowledge from time series: A case study in ecological data , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[29]  Dimitri Perrin,et al.  Complexity and high-end computing in biology and medicine. , 2011, Advances in Experimental Medicine and Biology.

[30]  Tobi Delbrück,et al.  Fast sensory motor control based on event-based hybrid neuromorphic-procedural system , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[31]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[32]  Nikola Kasabov,et al.  Quantum-Inspired Evolutionary Algorithm: , 2009 .

[33]  James C. Bezdek,et al.  Analysis of fuzzy information , 1987 .

[34]  Stefano Fusi.  Spike-driven Synaptic Plasticity for Learning Correlated Patterns of Mean Firing Rates , 2003, Reviews in the neurosciences.

[35]  Giacomo Indiveri,et al.  Online spatio-temporal pattern recognition with evolving spiking neural networks utilising address event representation, rank order, and temporal spike learning , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[36]  J. Talairach,et al.  Co-Planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System: An Approach to Cerebral Imaging , 1988 .

[37]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.

[38]  John Ashburner,et al.  Kernel regression for fMRI pattern prediction , 2011, NeuroImage.

[39]  W. Maass,et al.  State-dependent computations: spatiotemporal processing in cortical networks , 2009, Nature Reviews Neuroscience.

[40]  Maryam Gholami Doborjeh,et al.  Classification and segmentation of fMRI Spatio-Temporal Brain Data with a NeuCube evolving Spiking Neural Network model , 2014, 2014 IEEE Symposium on Evolving and Autonomous Learning Systems (EALS).

[41]  Seiichi Ozawa,et al.  An Incremental Learning Algorithm of , 2009 .

[42]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[43]  Nikola K. Kasabov,et al.  Evolving connectionist systems - the knowledge engineering approach (2. ed.) , 2007 .

[44]  Nikola K. Kasabov,et al.  To spike or not to spike: A probabilistic spiking neuron model , 2010, Neural Networks.

[45]  Wulfram Gerstner,et al.  Theory and Simulation in Neuroscience , 2012, Science.

[46]  Pappas Ioannis,et al.  StarPlus fMRI data , 2015 .

[47]  Maryam Gholami Doborjeh,et al.  Mapping, Learning, Visualization, Classification, and Understanding of fMRI Data in the NeuCube Evolving Spatiotemporal Data Machine of Spiking Neural Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[48]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[49]  G. Goranović,et al.  Theory and simulation. , 1996, Current opinion in structural biology.

[50]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[51]  Nikola K. Kasabov,et al.  Classification of fMRI Data in the NeuCube Evolving Spiking Neural Network Architecture , 2014, ICONIP.

[52]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[53]  Nikola K. Kasabov,et al.  Spiking neural network methodology for modelling, classification and understanding of EEG spatio-temporal data measuring cognitive processes , 2015, Inf. Sci..

[54]  S. Furber,et al.  To build a brain , 2012, IEEE Spectrum.

[55]  Jin Hu,et al.  EEG-based classification of upper-limb ADL using SNN for active robotic rehabilitation , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.