Deep Learning of Explainable EEG Patterns as Dynamic Spatiotemporal Clusters and Rules in a Brain-Inspired Spiking Neural Network

The paper proposes a new method for deep learning and knowledge discovery in a brain-inspired Spiking Neural Networks (SNN) architecture that enhances the model’s explainability while learning from streaming spatiotemporal brain data (STBD) in an incremental and on-line mode of operation. This led to the extraction of spatiotemporal rules from SNN models that explain why a certain decision (output prediction) was made by the model. During the learning process, the SNN created dynamic neural clusters, captured as polygons, which evolved in time and continuously changed their size and shape. The dynamic patterns of the clusters were quantitatively analyzed to identify the important STBD features that correspond to the most activated brain regions. We studied the trend of dynamically created clusters and their spike-driven events that occur together in specific space and time. The research contributes to: (1) enhanced interpretability of SNN learning behavior through dynamic neural clustering; (2) feature selection and enhanced accuracy of classification; (3) spatiotemporal rules to support model explainability; and (4) a better understanding of the dynamics in STBD in terms of feature interaction. The clustering method was applied to a case study of Electroencephalogram (EEG) data, recorded from a healthy control group (n = 21) and opiate use (n = 18) subjects while they were performing a cognitive task. The SNN models of EEG demonstrated different trends of dynamic clusters across the groups. This suggested to select a group of marker EEG features and resulted in an improved accuracy of EEG classification to 92%, when compared with all-feature classification. During learning of EEG data, the areas of neurons in the SNN model that form adjacent clusters (corresponding to neighboring EEG channels) were detected as fuzzy boundaries that explain overlapping activity of brain regions for each group of subjects.

[1]  Jacques Felblinger,et al.  Automated cortical projection of EEG sensors: Anatomical correlation via the international 10–10 system , 2009, NeuroImage.

[2]  Wolfgang Maass,et al.  Networks of Spiking Neurons: The Third Generation of Neural Network Models , 1996, Electron. Colloquium Comput. Complex..

[3]  Maryam Gholami Doborjeh,et al.  Dynamic 3D Clustering of Spatio-Temporal Brain Data in the NeuCube Spiking Neural Network Architecture on a Case Study of fMRI Data , 2015, ICONIP.

[4]  Shlomo Greenberg,et al.  Using a Low-Power Spiking Continuous Time Neuron (SCTN) for Sound Signal Processing , 2021, Sensors.

[5]  Nikola Kasabov,et al.  New Algorithms for Encoding, Learning and Classification of fMRI Data in a Spiking Neural Network Architecture: A Case on Modeling and Understanding of Dynamic Cognitive Processes , 2017, IEEE Transactions on Cognitive and Developmental Systems.

[6]  George Karypis,et al.  Evaluation of hierarchical clustering algorithms for document datasets , 2002, CIKM '02.

[7]  Sergey A Lobov,et al.  Competitive Learning in a Spiking Neural Network: Towards an Intelligent Pattern Classifier , 2020, Sensors.

[8]  Sander M. Bohte,et al.  The evidence for neural information processing with precise spike-times: A survey , 2004, Natural Computing.

[9]  Maryam Gholami Doborjeh,et al.  A Spiking Neural Network Methodology and System for Learning and Comparative Analysis of EEG Data From Healthy Versus Addiction Treated Versus Addiction Not Treated Subjects , 2016, IEEE Transactions on Biomedical Engineering.

[10]  Jacques Gautrais,et al.  Rank order coding , 1998 .

[11]  Maryam Gholami Doborjeh,et al.  Prediction of tinnitus masking benefit within a case series using a spiking neural network model. , 2020, Progress in brain research.

[12]  Maryam Gholami Doborjeh,et al.  Evolving, dynamic clustering of spatio/spectro-temporal data in 3D spiking neural network models and a case study on EEG data , 2018, Evol. Syst..

[13]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[14]  Prof. Dr. Dr. Valentino Braitenberg,et al.  Cortex: Statistics and Geometry of Neuronal Connectivity , 1998, Springer Berlin Heidelberg.

[15]  Nikola Kasabov,et al.  Time-Space, Spiking Neural Networks and Brain-Inspired Artificial Intelligence , 2018, Springer Series on Bio- and Neurosystems.

[16]  Saad Arslan,et al.  A Low-Power Spiking Neural Network Chip Based on a Compact LIF Neuron and Binary Exponential Charge Injector Synapse Circuits , 2021, Sensors.

[17]  Nikola Kasabov,et al.  Dynamic evolving spiking neural networks for on-line spatio- and spectro-temporal pattern recognition. , 2013, Neural networks : the official journal of the International Neural Network Society.

[18]  B. Schrauwen,et al.  BSA, a fast and accurate spike train encoding scheme , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[19]  Seong-Ook Jung,et al.  Area- and Energy-Efficient STDP Learning Algorithm for Spiking Neural Network SoC , 2020, IEEE Access.

[20]  Nikola Kasabov,et al.  Deep learning and deep knowledge representation in Spiking Neural Networks for Brain-Computer Interfaces , 2020, Neural Networks.

[21]  Nikola K. Kasabov,et al.  Spike-time encoding as a data compression technique for pattern recognition of temporal data , 2017, Inf. Sci..

[22]  Maryam Gholami Doborjeh,et al.  Mapping, Learning, Visualization, Classification, and Understanding of fMRI Data in the NeuCube Evolving Spatiotemporal Data Machine of Spiking Neural Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Nikola Kasabov,et al.  Personalised modelling with spiking neural networks integrating temporal and static information , 2019, Neural Networks.

[24]  Maryam Gholami Doborjeh,et al.  Personalised modelling on integrated clinical and EEG Spatio-Temporal Brain Data in the NeuCube Spiking Neural Network system , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[25]  Z. Doborjeh.  Modelling of Spatiotemporal EEG and ERP Brain Data for Dynamic Pattern Recognition and Brain State Prediction using Spiking Neural Networks: Methods and Applications in Psychology , 2019 .

[26]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[27]  Nikola K. Kasabov,et al.  NeuCube: A spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data , 2014, Neural Networks.

[28]  Maryam Gholami Doborjeh,et al.  Classification and segmentation of fMRI Spatio-Temporal Brain Data with a NeuCube evolving Spiking Neural Network model , 2014, 2014 IEEE Symposium on Evolving and Autonomous Learning Systems (EALS).

[29]  Zohreh Doborjeh,et al.  Interpretability of Spatiotemporal Dynamics of the Brain Processes Followed by Mindfulness Intervention in a Brain-Inspired Spiking Neural Network Architecture , 2020, Sensors.

[30]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[31]  Bruce W. Knight,et al.  Dynamics of Encoding in a Population of Neurons , 1972, The Journal of general physiology.

[32]  Francesco Carlo Morabito,et al.  Longitudinal study of alzheimer's disease degeneration through EEG data analysis with a NeuCube spiking neural network model , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[33]  Giacomo Indiveri,et al.  Online spatio-temporal pattern recognition with evolving spiking neural networks utilising address event representation, rank order, and temporal spike learning , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[34]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .

[35]  Nikola Kasabov,et al.  Spiking Neural Network Modelling Approach Reveals How Mindfulness Training Rewires the Brain , 2019, Scientific Reports.