Reconfigurable Digital Design of a Liquid State Machine for Spatio-Temporal Data

Liquid State Machine (LSM) is an adaptive computational model with rich dynamics to process continuous streams of inputs. The generalizable capability of LSM makes it a powerful intelligent engine, with very fast training capabilities. Reconfigurable hardware architectures for spatiotemporal signal processing algorithms like LSMs are energy efficient compared to the traditional Recurrent Neural Netork (RNN) and can also adapt to real-time changes without being application specific. Existing behavioral models of LSM cannot process real time data due to their hardware complexity or fixed design approach. The proposed model focuses on a simple liquid design that exploits spatial locality and is capable of processing real time data. The proposed reservoir hardware is evaluated for epileptic seizure detection with an average accuracy of 85%.

[1]  Shaista Hussain,et al.  Hardware efficient, neuromorphic dendritically enhanced readout for liquid state machines , 2013, 2013 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[2]  Abdulhamit Subasi,et al.  EEG signal classification using wavelet feature extraction and a mixture of expert model , 2007, Expert Syst. Appl..

[3]  Cory Merkel,et al.  Design and Analysis of a Neuromemristive Reservoir Computing Architecture for Biosignal Processing , 2016, Front. Neurosci..

[4]  V. Srinivasan,et al.  Artificial Neural Network Based Epileptic Detection Using Time-Domain and Frequency-Domain Features , 2005, Journal of Medical Systems.

[5]  Herbert Jaeger,et al.  Reservoir computing approaches to recurrent neural network training , 2009, Comput. Sci. Rev..

[6]  K Lehnertz,et al.  Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: dependence on recording region and brain state. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  Eris Chinellato,et al.  Facial expression recognition based on Liquid State Machines built of alternative neuron models , 2009, 2009 International Joint Conference on Neural Networks.

[8]  Daniel Rivero,et al.  Classification of EEG signals using relative wavelet energy and artificial neural networks , 2009, GEC '09.

[9]  Henry Markram,et al.  Neural Networks with Dynamic Synapses , 1998, Neural Computation.

[10]  Yong Zhang,et al.  A Digital Liquid State Machine With Biologically Inspired Learning and Its Application to Speech Recognition , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Dario Floreano,et al.  Hardware spiking neural network with run-time reconfigurable connectivity in an autonomous robot , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[12]  Dimitrios I. Fotiadis,et al.  Automatic Seizure Detection Based on Time-Frequency Analysis and Artificial Neural Networks , 2007, Comput. Intell. Neurosci..

[13]  Daniel Rivero,et al.  Epileptic seizure detection using multiwavelet transform based approximate entropy and artificial neural networks , 2010, Journal of Neuroscience Methods.

[14]  B. Schrauwen,et al.  BSA, a fast and accurate spike train encoding scheme , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[15]  Martin Haenggi,et al.  Throughput Analysis of Fading Sensor Networks with Regular and Random Topologies , 2005, EURASIP J. Wirel. Commun. Netw..

[16]  Andres Upegui,et al.  An FPGA platform for on-line topology exploration of spiking neural networks , 2005, Microprocess. Microsystems.

[17]  Benjamin Schrauwen,et al.  Compact hardware liquid state machines on FPGA for real-time speech recognition , 2008, Neural Networks.

[18]  Hugo de Garis,et al.  Evolving an optimal de/convolution function for the neural net modules of ATR's artificial brain project , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[19]  Herbert Jaeger,et al.  Adaptive Nonlinear System Identification with Echo State Networks , 2002, NIPS.

[20]  B. Schrauwen,et al.  Isolated word recognition with the Liquid State Machine: a case study , 2005, Inf. Process. Lett..

[21]  Benjamin Schrauwen,et al.  Parallel hardware implementation of a broad class of spiking neurons using serial arithmetic , 2006, ESANN.

[22]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[23]  Benjamin Schrauwen,et al.  Compact hardware for real-time speech recognition using a Liquid State Machine , 2007, 2007 International Joint Conference on Neural Networks.

[24]  Bernard Girau,et al.  Massively distributed digital implementation of an integrate-and-fire LEGION network for visual scene segmentation , 2007, Neurocomputing.

[25]  U. Rajendra Acharya,et al.  Entropies for detection of epilepsy in EEG , 2005, Comput. Methods Programs Biomed..

[26]  Robert A. Legenstein,et al.  2007 Special Issue: Edge of chaos and prediction of computational performance for neural circuit models , 2007 .