Efficient Biosignal Processing Using Hyperdimensional Computing: Network Templates for Combined Learning and Classification of ExG Signals

Recognizing the very size of the brain’s circuits, hyperdimensional (HD) computing can model neural activity patterns with points in a HD space, that is, with HD vectors. Key examined properties of HD computing include: a versatile set of arithmetic operations on HD vectors, generality, scalability, analyzability, one-shot learning, and energy efficiency. These make it a prime candidate for efficient biosignal processing where signals are noisy and nonstationary, training data sets are not huge, individual variability is significant, and energy-efficiency constraints are tight. Purely based on native HD computing operators, we describe a combined method for multiclass learning and classification of various ExG biosignals such as electromyography (EMG), electroencephalography (EEG), and electrocorticography (ECoG). We develop a full set of HD network templates that comprehensively encode body potentials and brain neural activity recorded from different electrodes into a single HD vector without requiring domain expert knowledge or ad hoc electrode selection process. Such encoded HD vector is processed as a single unit for fast one-shot learning, and robust classification. It can be interpreted to identify the most useful features as well. Compared to state-of-the-art counterparts, HD computing enables online, incremental, and fast learning as it demands less than a third as much training data as well as less preprocessing.

[1]  Haim Sompolinsky,et al.  Optimal Degrees of Synaptic Connectivity , 2017, Neuron.

[2]  Ricardo Chavarriaga,et al.  Adaptive Assistance for Brain-Computer Interfaces by Online Prediction of Command Reliability , 2016, IEEE Computational Intelligence Magazine.

[3]  C. Finney,et al.  A review of symbolic analysis of experimental data , 2003 .

[4]  Okko Johannes Räsänen,et al.  Sequence Prediction With Sparse Distributed Hyperdimensional Coding Applied to the Analysis of Mobile Phone Use Patterns , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Klaus-Robert Müller,et al.  Neurophysiological predictor of SMR-based BCI performance , 2010, NeuroImage.

[6]  Deng Cai,et al.  Laplacian Score for Feature Selection , 2005, NIPS.

[7]  Mohsen Imani,et al.  VoiceHD: Hyperdimensional Computing for Efficient Speech Recognition , 2017, 2017 IEEE International Conference on Rebooting Computing (ICRC).

[8]  Pentti Kanerva,et al.  Sparse Distributed Memory , 1988 .

[9]  Evgeny Osipov,et al.  Modality classification of medical images with distributed representations based on cellular automata reservoir computing , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[10]  Tajana Simunic,et al.  HDNA: Energy-efficient DNA sequencing using hyperdimensional computing , 2018, 2018 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[11]  Friedrich T. Sommer,et al.  A Theory of Sequence Indexing and Working Memory in Recurrent Neural Networks , 2018, Neural Computation.

[12]  Anders Holst,et al.  Random indexing of text samples for latent semantic analysis , 2000 .

[13]  José del R. Millán,et al.  You Are Wrong! - Automatic Detection of Interaction Errors from Brain Waves , 2005, IJCAI.

[14]  Ross W. Gayler Vector Symbolic Architectures answer Jackendoff's challenges for cognitive neuroscience , 2004, ArXiv.

[15]  Fredrik Sandin,et al.  Analogical mapping and inference with binary spatter codes and sparse distributed memory , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[16]  Gunnar Blohm,et al.  Multi-Class Motor Imagery EEG Decoding for Brain-Computer Interfaces , 2012, Front. Neurosci..

[17]  Davide Rossi,et al.  Flexible, Scalable and Energy Efficient Bio-Signals Processing on the PULP Platform: A Case Study on Seizure Detection , 2017 .

[18]  Luca Benini,et al.  Hyperdimensional biosignal processing: A case study for EMG-based hand gesture recognition , 2016, 2016 IEEE International Conference on Rebooting Computing (ICRC).

[19]  Jan M. Rabaey,et al.  Exploring Hyperdimensional Associative Memory , 2017, 2017 IEEE International Symposium on High Performance Computer Architecture (HPCA).

[20]  Shuicheng Yan,et al.  Parallel convolutional-linear neural network for motor imagery classification , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[21]  Luca Benini,et al.  A Versatile Embedded Platform for EMG Acquisition and Gesture Recognition , 2015, IEEE Transactions on Biomedical Circuits and Systems.

[22]  Ram Bilas Pachori,et al.  Classification of seizure and seizure-free EEG signals using local binary patterns , 2015, Biomed. Signal Process. Control..

[23]  Pentti Kanerva,et al.  Hyperdimensional Computing: An Introduction to Computing in Distributed Representation with High-Dimensional Random Vectors , 2009, Cognitive Computation.

[24]  Kaspar Anton Schindler,et al.  On seeing the trees and the forest: Single‐signal and multisignal analysis of periictal intracranial EEG , 2012, Epilepsia.

[25]  Alexander Legalov,et al.  Associative synthesis of finite state automata model of a controlled object with hyperdimensional computing , 2017, IECON 2017 - 43rd Annual Conference of the IEEE Industrial Electronics Society.

[26]  Jan M. Rabaey,et al.  A Bio-Inspired Analog Gas Sensing Front End , 2017, IEEE Transactions on Circuits and Systems I: Regular Papers.

[27]  P. Kanerva,et al.  Hyperdimensional Computing for Text Classification , 2016 .

[28]  Jussi H. Poikonen,et al.  High-dimensional computing with sparse vectors , 2015, 2015 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[29]  Marian Verhelst,et al.  14.5 Envision: A 0.26-to-10TOPS/W subword-parallel dynamic-voltage-accuracy-frequency-scalable Convolutional Neural Network processor in 28nm FDSOI , 2017, 2017 IEEE International Solid-State Circuits Conference (ISSCC).

[30]  Haider Banka,et al.  Local pattern transformation based feature extraction techniques for classification of epileptic EEG signals , 2017, Biomed. Signal Process. Control..

[31]  Okko Johannes Räsänen,et al.  Generating Hyperdimensional Distributed Representations from Continuous-Valued Multivariate Sensory Input , 2015, CogSci.

[32]  Una-May O'Reilly,et al.  Large-scale physiological waveform retrieval via locality-sensitive hashing , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[33]  Jan M. Rabaey,et al.  Brain-inspired computing exploiting carbon nanotube FETs and resistive RAM: Hyperdimensional computing case study , 2018, 2018 IEEE International Solid - State Circuits Conference - (ISSCC).

[34]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[35]  Jan M. Rabaey,et al.  A Robust and Energy-Efficient Classifier Using Brain-Inspired Hyperdimensional Computing , 2016, ISLPED.

[36]  Luca Benini,et al.  One-shot Learning for iEEG Seizure Detection Using End-to-end Binary Operations: Local Binary Patterns with Hyperdimensional Computing , 2018, 2018 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[37]  Yitong Li,et al.  Targeting EEG/LFP Synchrony with Neural Nets , 2017, NIPS.

[38]  O Bertrand,et al.  A theoretical justification of the average reference in topographic evoked potential studies. , 1985, Electroencephalography and clinical neurophysiology.

[39]  Jan M. Rabaey,et al.  High-Dimensional Computing as a Nanoscalable Paradigm , 2017, IEEE Transactions on Circuits and Systems I: Regular Papers.

[40]  Jan M. Rabaey,et al.  Hyperdimensional computing for noninvasive brain-computer interfaces: Blind and one-shot classification of EEG error-related potentials , 2017 .

[41]  Jan M. Rabaey,et al.  Low-Power Sparse Hyperdimensional Encoder for Language Recognition , 2017, IEEE Design & Test.

[42]  R Chavarriaga,et al.  Learning From EEG Error-Related Potentials in Noninvasive Brain-Computer Interfaces , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[43]  Jacob Rosen,et al.  A myosignal-based powered exoskeleton system , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[44]  Jan M. Rabaey,et al.  Classification and Recall With Binary Hyperdimensional Computing: Tradeoffs in Choice of Density and Mapping Characteristics , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[45]  Jan M. Rabaey,et al.  Hyperdimensional Computing for Blind and One-Shot Classification of EEG Error-Related Potentials , 2020, Mob. Networks Appl..

[46]  Luca Benini,et al.  From Variability Tolerance to Approximate Computing in Parallel Integrated Architectures and Accelerators , 2017 .

[47]  J R Wolpaw,et al.  Spatial filter selection for EEG-based communication. , 1997, Electroencephalography and clinical neurophysiology.

[48]  Richard S. Zemel,et al.  Prototypical Networks for Few-shot Learning , 2017, NIPS.

[49]  Ross W. Gayler,et al.  Multiplicative Binding, Representation Operators & Analogy , 1998 .

[50]  Luca Benini,et al.  An EMG Gesture Recognition System with Flexible High-Density Sensors and Brain-Inspired High-Dimensional Classifier , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[51]  Dmitri A. Rachkovskij,et al.  Representation and Processing of Structures with Binary Sparse Distributed Codes , 2001, IEEE Trans. Knowl. Data Eng..

[52]  Chris Eliasmith,et al.  How to Build a Brain: A Neural Architecture for Biological Cognition , 2013 .

[53]  Pentti Kanerva,et al.  Binary Spatter-Coding of Ordered K-Tuples , 1996, ICANN.

[54]  Aditya Joshi,et al.  Language Geometry Using Random Indexing , 2016, QI.

[55]  Othman Omran Khalifa,et al.  EMG signal classification for human computer interaction: a review , 2009 .

[56]  Luca Benini,et al.  Hardware Optimizations of Dense Binary Hyperdimensional Computing: Rematerialization of Hypervectors, Binarized Bundling, and Combinational Associative Memory , 2019, ACM J. Emerg. Technol. Comput. Syst..

[57]  Jan M. Rabaey,et al.  Hyperdimensional computing with 3D VRRAM in-memory kernels: Device-architecture co-design for energy-efficient, error-resilient language recognition , 2016, 2016 IEEE International Electron Devices Meeting (IEDM).

[58]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b , 2012, Front. Neurosci..

[59]  Luca Benini,et al.  Variability Mitigation in Nanometer CMOS Integrated Systems: A Survey of Techniques From Circuits to Software , 2016, Proceedings of the IEEE.

[60]  Trevor Cohen,et al.  Reasoning with vectors: A continuous model for fast robust inference , 2015, Log. J. IGPL.

[61]  Luca Benini,et al.  PULP-HD: Accelerating Brain-Inspired High-Dimensional Computing on a Parallel Ultra-Low Power Platform , 2018, 2018 55th ACM/ESDA/IEEE Design Automation Conference (DAC).

[62]  A. Anonymous,et al.  Consumer Data Privacy in a Networked World: A Framework for Protecting Privacy and Promoting Innovation in the Global Digital Economy , 2013, J. Priv. Confidentiality.

[63]  Dieter Schmidt,et al.  Evidence-based review on the natural history of the epilepsies. , 2012, Current opinion in neurology.

[64]  Özgür Yilmaz,et al.  Symbolic Computation Using Cellular Automata-Based Hyperdimensional Computing , 2015, Neural Computation.

[65]  Dapeng Yang,et al.  Experimental Study of an EMG-Controlled 5-DOF Anthropomorphic Prosthetic Hand for Motion Restoration , 2014, J. Intell. Robotic Syst..

[66]  Tony A. Plate,et al.  Holographic reduced representations , 1995, IEEE Trans. Neural Networks.

[67]  J. Millán,et al.  Error-related EEG potentials in brain-computer interfaces , 2007 .

[68]  Pentti Kanerva,et al.  What We Mean When We Say "What's the Dollar of Mexico?": Prototypes and Mapping in Concept Space , 2010, AAAI Fall Symposium: Quantum Informatics for Cognitive, Social, and Semantic Processes.

[69]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[70]  Pentti Kanerva Computing with 10,000-bit words , 2014, 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[71]  Robert L. West,et al.  A framework for computational models of human memory , 2019 .