A 128-Channel FPGA-Based Real-Time Spike-Sorting Bidirectional Closed-Loop Neural Interface System

A multichannel neural interface system is an important tool for various types of neuroscientific studies. For the electrical interface with a biological system, high-precision high-speed data recording and various types of stimulation capability are required. In addition, real-time signal processing is an important feature in the implementation of a real-time closed-loop system without unwanted substantial delay for feedback stimulation. Online spike sorting, the process of assigning neural spikes to an identified group of neurons or clusters, is a necessary step to make a closed-loop path in real time, but massive memory-space requirements commonly limit hardware implementations. Here, we present a 128-channel field-programmable gate array (FPGA)-based real-time closed-loop bidirectional neural interface system. The system supports 128 channels for simultaneous signal recording and eight selectable channels for stimulation. A modular 64-channel analog front-end (AFE) provides scalability and a parameterized specification of the AFE supports the recording of various electrophysiological signal types with 1.59 ± 0.76 $\mu {V}$ root-mean-square noise. The stimulator supports both voltage-controlled and current-controlled arbitrarily shaped waveforms with the programmable amplitude and duration of pulse. An empirical algorithm for online real-time spike sorting is implemented in an FPGA. The spike-sorting is performed by template matching, and templates are created by an online real-time unsupervised learning process. A memory saving technique, called dynamic cache organizing, is proposed to reduce the memory requirement down to 6 kbit per channel and modular implementation improves the scalability for further extensions.

[1]  Luca Berdondini,et al.  Active pixel sensor array for high spatio-temporal resolution electrophysiological recordings from single cell to large scale neuronal networks. , 2009, Lab on a chip.

[2]  Jose M. Carmena,et al.  A System for Neural Recording and Closed-Loop Intracortical Microstimulation in Awake Rodents , 2009, IEEE Transactions on Biomedical Engineering.

[3]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.

[4]  A. M. Kamboh,et al.  Computationally Efficient Neural Feature Extraction for Spike Sorting in Implantable High-Density Recording Systems , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Jongkil Park,et al.  A 65k-neuron 73-Mevents/s 22-pJ/event asynchronous micro-pipelined integrate-and-fire array transceiver , 2014, 2014 IEEE Biomedical Circuits and Systems Conference (BioCAS) Proceedings.

[6]  H. Yokoi,et al.  Real-time control of a prosthetic hand using human electrocorticography signals. , 2011, Journal of neurosurgery.

[7]  W. Liu,et al.  A 128-Channel 6 mW Wireless Neural Recording IC With Spike Feature Extraction and UWB Transmitter , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Timothy G. Constandinou,et al.  Feature extraction using first and second derivative extrema (FSDE) for real-time and hardware-efficient spike sorting , 2013, Journal of Neuroscience Methods.

[9]  Arjun K. Bansal,et al.  Relationships among low-frequency local field potentials, spiking activity, and three-dimensional reach and grasp kinematics in primary motor and ventral premotor cortices. , 2011, Journal of neurophysiology.

[10]  Steve M. Potter,et al.  A Low-Cost Multielectrode System for Data Acquisition Enabling Real-Time Closed-Loop Processing with Rapid Recovery from Stimulation Artifacts , 2009, Front. Neuroeng..

[11]  E. Fetz,et al.  Long-term motor cortex plasticity induced by an electronic neural implant , 2006, Nature.

[12]  Wim L. C. Rutten,et al.  Long-term characterization of firing dynamics of spontaneous bursts in cultured neural networks , 2004, IEEE Transactions on Biomedical Engineering.

[13]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[14]  Steve M. Potter,et al.  Controlling Bursting in Cortical Cultures with Closed-Loop Multi-Electrode Stimulation , 2005, The Journal of Neuroscience.

[15]  Timothy G. Constandinou,et al.  Live demonstration: A scalable 32-channel neural recording and real-time FPGA based spike sorting system , 2015, 2015 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[16]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces to restore motor function and probe neural circuits , 2003, Nature Reviews Neuroscience.

[17]  Jerald D. Kralik,et al.  Real-time prediction of hand trajectory by ensembles of cortical neurons in primates , 2000, Nature.

[18]  Miroslaw Zoladz,et al.  A complete 256-channel reconfigurable system for in vitro neurobiological experiments , 2013, 2013 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[19]  Miguel A. L. Nicolelis,et al.  Principles of neural ensemble physiology underlying the operation of brain–machine interfaces , 2009, Nature Reviews Neuroscience.

[20]  D. Markovic,et al.  A 130-μW, 64-channel spike-sorting DSP chip , 2009, 2009 IEEE Asian Solid-State Circuits Conference.

[21]  Andrew Jackson,et al.  Minimum requirements for accurate and efficient real-time on-chip spike sorting , 2014, Journal of Neuroscience Methods.

[22]  Steve M. Potter,et al.  A versatile all-channel stimulator for electrode arrays, with real-time control , 2004, Journal of neural engineering.

[23]  Stephen P. DeWeerth,et al.  An Integrated System for Simultaneous, Multichannel Neuronal Stimulation and Recording , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.

[24]  Sang-Don Jung,et al.  In vitro extracellular recording and stimulation performance of nanoporous gold-modified multi-electrode arrays , 2015, Journal of neural engineering.

[25]  Yannick Bornat,et al.  In vitro large-scale experimental and theoretical studies for the realization of bi-directional brain-prostheses , 2013, Front. Neural Circuits.

[26]  L. Miller,et al.  Restoring sensorimotor function through intracortical interfaces: progress and looming challenges , 2014, Nature Reviews Neuroscience.

[27]  J. Weiland,et al.  Perceptual thresholds and electrode impedance in three retinal prosthesis subjects , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  Zhi Yang,et al.  A biomedical multiprocessor SoC for closed-loop neuroprosthetic applications , 2009, 2009 IEEE International Solid-State Circuits Conference - Digest of Technical Papers.

[29]  Steve M. Potter,et al.  Shaping Embodied Neural Networks for Adaptive Goal-directed Behavior , 2008, PLoS Comput. Biol..

[30]  Alessandro Vato,et al.  Dissociated cortical networks show spontaneously correlated activity patterns during in vitro development , 2006, Brain Research.

[31]  Robert D Flint,et al.  Long term, stable brain machine interface performance using local field potentials and multiunit spikes , 2013, Journal of neural engineering.

[32]  Steve M. Potter,et al.  Effective parameters for stimulation of dissociated cultures using multi-electrode arrays , 2004, Journal of Neuroscience Methods.

[33]  Chaitali Chakrabarti,et al.  Efficient Bayesian Tracking of Multiple Sources of Neural Activity: Algorithms and Real-Time FPGA Implementation , 2013, IEEE Transactions on Signal Processing.

[34]  Eytan Domany,et al.  Data Clustering Using a Model Granular Magnet , 1997, Neural Computation.

[35]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[36]  Michael Q. Zhang,et al.  Neighbor number, valley seeking and clustering , 2007, Pattern Recognit. Lett..

[37]  Yu Wang,et al.  Real-time high-quality stereo vision system in FPGA , 2013, 2013 International Conference on Field-Programmable Technology (FPT).

[38]  Ueli Rutishauser,et al.  Online detection and sorting of extracellularly recorded action potentials in human medial temporal lobe recordings, in vivo , 2006, Journal of Neuroscience Methods.

[39]  U. Frey,et al.  A CMOS-based microelectrode array for interaction with neuronal cultures , 2007, Journal of Neuroscience Methods.

[40]  A. Zviagintsev,et al.  Low-Power Architectures for Spike Sorting , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[41]  S. Acharya,et al.  Toward Electrocorticographic Control of a Dexterous Upper Limb Prosthesis: Building Brain-Machine Interfaces , 2012, IEEE Pulse.

[42]  Henry Chen,et al.  A 75µW, 16-channel neural spike-sorting processor with unsupervised clustering , 2011, 2011 Symposium on VLSI Circuits - Digest of Technical Papers.

[43]  M S Lewicki,et al.  A review of methods for spike sorting: the detection and classification of neural action potentials. , 1998, Network.

[44]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[45]  Dejan Markovic,et al.  Spike Sorting: The First Step in Decoding the Brain: The first step in decoding the brain , 2012, IEEE Signal Processing Magazine.

[46]  P. Walter,et al.  Evoked cortical potentials after electrical stimulation of the inner retina in rabbits , 2000, Graefe's Archive for Clinical and Experimental Ophthalmology.