Energy Efficient In-Memory Hyperdimensional Encoding for Spatio-Temporal Signal Processing

The emerging brain-inspired computing paradigm known as hyperdimensional computing (HDC) has been proven to provide a lightweight learning framework for various cognitive tasks compared to the widely used deep learning-based approaches. Spatio-temporal (ST) signal processing, which encompasses biosignals such as electromyography (EMG) and electroencephalography (EEG), is one family of applications that could benefit from an HDC-based learning framework. At the core of HDC lie manipulations and comparisons of large bit patterns, which are inherently ill-suited to conventional computing platforms based on the von-Neumann architecture. In this work, we propose an architecture for ST signal processing within the HDC framework using predominantly in-memory compute arrays. In particular, we introduce a methodology for the in-memory hyperdimensional encoding of ST data to be used together with an in-memory associative search module. We show that the in-memory HDC encoder for ST signals offers at least <inline-formula> <tex-math notation="LaTeX">$1.80\times $ </tex-math></inline-formula> energy efficiency gains, <inline-formula> <tex-math notation="LaTeX">$3.36\times $ </tex-math></inline-formula> area gains, as well as <inline-formula> <tex-math notation="LaTeX">$9.74\times $ </tex-math></inline-formula> throughput gains compared with a dedicated digital hardware implementation. At the same time it achieves a peak classification accuracy within 0.04% of that of the baseline HDC framework.

[1]  Luca Benini,et al.  Integrating event-based dynamic vision sensors with sparse hyperdimensional computing: a low-power accelerator with online learning capability , 2020, ISLPED.

[2]  Tajana Simunic,et al.  Efficient human activity recognition using hyperdimensional computing , 2018, IOT.

[3]  Luca Benini,et al.  Efficient Biosignal Processing Using Hyperdimensional Computing: Network Templates for Combined Learning and Classification of ExG Signals , 2019, Proceedings of the IEEE.

[4]  Yiannis Aloimonos,et al.  Learning sensorimotor control with neuromorphic sensors: Toward hyperdimensional active perception , 2019, Science Robotics.

[5]  Jan M. Rabaey,et al.  Hyperdimensional computing for noninvasive brain-computer interfaces: Blind and one-shot classification of EEG error-related potentials , 2017 .

[6]  Luca Benini,et al.  One-shot Learning for iEEG Seizure Detection Using End-to-end Binary Operations: Local Binary Patterns with Hyperdimensional Computing , 2018, 2018 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[7]  Jan M. Rabaey,et al.  Brain-inspired computing exploiting carbon nanotube FETs and resistive RAM: Hyperdimensional computing case study , 2018, 2018 IEEE International Solid - State Circuits Conference - (ISSCC).

[8]  Tajana Simunic,et al.  HDNA: Energy-efficient DNA sequencing using hyperdimensional computing , 2018, 2018 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[9]  Okko Johannes Räsänen,et al.  Modeling Dependencies in Multiple Parallel Data Streams with Hyperdimensional Computing , 2014, IEEE Signal Processing Letters.

[10]  Jan M. Rabaey,et al.  A Robust and Energy-Efficient Classifier Using Brain-Inspired Hyperdimensional Computing , 2016, ISLPED.

[11]  Luca Benini,et al.  Hyperdimensional biosignal processing: A case study for EMG-based hand gesture recognition , 2016, 2016 IEEE International Conference on Rebooting Computing (ICRC).

[12]  Mohsen Imani,et al.  VoiceHD: Hyperdimensional Computing for Efficient Speech Recognition , 2017, 2017 IEEE International Conference on Rebooting Computing (ICRC).

[13]  H.-S. Philip Wong,et al.  Device-architecture co-design for hyperdimensional computing with 3d vertical resistive switching random access memory (3D VRRAM) , 2017, 2017 International Symposium on VLSI Technology, Systems and Application (VLSI-TSA).

[14]  Luca Benini,et al.  PULP-HD: Accelerating Brain-Inspired High-Dimensional Computing on a Parallel Ultra-Low Power Platform , 2018, 2018 55th ACM/ESDA/IEEE Design Automation Conference (DAC).

[15]  J. Rabaey,et al.  A wearable biosensing system with in-sensor adaptive machine learning for hand gesture recognition , 2020, Nature Electronics.

[16]  Marcus Liwicki,et al.  HyperEmbed: Tradeoffs Between Resources and Performance in NLP Tasks with Hyperdimensional Computing Enabled Embedding of n-gram Statistics , 2019, 2021 International Joint Conference on Neural Networks (IJCNN).

[17]  Theodore Antonakopoulos,et al.  Mixed-Precision Deep Learning Based on Computational Memory , 2020, Frontiers in Neuroscience.

[18]  P. Kanerva,et al.  Hyperdimensional Computing for Text Classification , 2016 .

[19]  Pentti Kanerva,et al.  Hyperdimensional Computing: An Introduction to Computing in Distributed Representation with High-Dimensional Random Vectors , 2009, Cognitive Computation.

[20]  Fredrik Sandin,et al.  Analogical mapping and inference with binary spatter codes and sparse distributed memory , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[21]  Luca Benini,et al.  An EMG Gesture Recognition System with Flexible High-Density Sensors and Brain-Inspired High-Dimensional Classifier , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[22]  Luca Benini,et al.  In-memory hyperdimensional computing , 2019, Nature Electronics.

[23]  Luca Benini,et al.  PULP-HD: Accelerating Brain-Inspired High-Dimensional Computing on a Parallel Ultra-Low Power Platform , 2018, 2018 55th ACM/ESDA/IEEE Design Automation Conference (DAC).

[24]  Pentti Kanerva,et al.  What We Mean When We Say "What's the Dollar of Mexico?": Prototypes and Mapping in Concept Space , 2010, AAAI Fall Symposium: Quantum Informatics for Cognitive, Social, and Semantic Processes.

[25]  Aditya Joshi,et al.  Language Geometry Using Random Indexing , 2016, QI.

[26]  Heiner Giefers,et al.  Mixed-precision in-memory computing , 2017, Nature Electronics.