Low-latency single channel real-time neural spike sorting system based on template matching

Recent technical advancements in neural engineering allow for precise recording and control of neural circuits simultaneously, opening up new opportunities for closed-loop neural control. In this work, a rapid spike sorting system was developed based on template matching to rapidly calculate instantaneous firing rates for each neuron in a multi-unit extracellular recording setting. Cluster templates were first generated by a desktop computer using a non-parameter spike sorting algorithm (Super-paramagnetic clustering) and then transferred to a field-programmable gate array digital circuit for rapid sorting through template matching. Two different matching techniques–Euclidean distance (ED) and correlational matching (CM)–were compared for the accuracy of sorting and the performance of calculating firing rates. The performance of the system was first verified using publicly available artificial data and was further confirmed with pre-recorded neural spikes from an anesthetized Mongolian gerbil. Real-time recording and sorting from an awake mouse were also conducted to confirm the system performance in a typical behavioral neuroscience experimental setting. Experimental results indicated that high sorting accuracies were achieved for both template-matching methods, but CM can better handle spikes with non-Gaussian spike distributions, making it more robust for in vivo recording. The technique was also compared to several other off-line spike sorting algorithms and the results indicated that the sorting accuracy is comparable but sorting time is significantly shorter than these other techniques. A low sorting latency of under 2 ms and a maximum spike sorting rate of 941 spikes/second have been achieved with our hybrid hardware/software system. The low sorting latency and fast sorting rate allow future system developments of neural circuit modulation through analyzing neural activities in real-time.

[1]  D. Gire,et al.  ϒ Spike-Field Coherence in a Population of Olfactory Bulb Neurons Differentiates between Odors Irrespective of Associated Outcome , 2015, Journal of Neuroscience.

[2]  Steve M. Potter,et al.  Optogenetic feedback control of neural activity , 2015, eLife.

[3]  Jongkil Park,et al.  A 128-Channel FPGA-Based Real-Time Spike-Sorting Bidirectional Closed-Loop Neural Interface System , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  Jack W. Judy,et al.  An FPGA-based platform for accelerated offline spike sorting , 2013, Journal of Neuroscience Methods.

[5]  Robert P. Vertes,et al.  Electrophysiological Recording Techniques , 2011 .

[6]  Jadin C. Jackson,et al.  Quantitative measures of cluster quality for use in extracellular recordings , 2005, Neuroscience.

[7]  Franklin Bretschneider,et al.  Introduction to Electrophysiological Methods and Instrumentation , 2006 .

[8]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[9]  K.D. Wise,et al.  A three-dimensional neural recording microsystem with implantable data compression circuitry , 2005, IEEE Journal of Solid-State Circuits.

[10]  Pierre Yger,et al.  A spike sorting toolbox for up to thousands of electrodes validated with ground truth recordings in vitro and in vivo , 2018, eLife.

[11]  Alexander Bertrand,et al.  Towards online spike sorting for high-density neural probes using discriminative template matching with suppression of interfering spikes , 2018, Journal of neural engineering.

[12]  Dennis Sylvester,et al.  A 128-channel spike sorting processor featuring 0.175 µW and 0.0033 mm2 per channel in 65-nm CMOS , 2016, 2016 IEEE Symposium on VLSI Circuits (VLSI-Circuits).

[13]  Susannah J Tye,et al.  Towards miniaturized closed-loop optogenetic stimulation devices , 2018, Journal of neural engineering.

[14]  Matteo Carandini,et al.  Kilosort: realtime spike-sorting for extracellular electrophysiology with hundreds of channels , 2016, bioRxiv.

[15]  Douglas J. Bakkum,et al.  Revealing neuronal function through microelectrode array recordings , 2015, Front. Neurosci..

[16]  W. Krauth Cluster Monte Carlo algorithms , 2003, cond-mat/0311623.

[17]  Vaibhav Karkare,et al.  A 130-$\mu$ W, 64-Channel Neural Spike-Sorting DSP Chip , 2011, IEEE Journal of Solid-State Circuits.

[18]  Eero P. Simoncelli,et al.  A Model-Based Spike Sorting Algorithm for Removing Correlation Artifacts in Multi-Neuron Recordings , 2013, PloS one.

[19]  R. Quian Quiroga,et al.  Unsupervised Spike Detection and Sorting with Wavelets and Superparamagnetic Clustering , 2004, Neural Computation.

[20]  Piotr Porwik,et al.  The Haar – Wavelet Transform in Digital Image Processing : Its Status and Achievements , 2004 .

[21]  Dejan Markovic,et al.  Technology-Aware Algorithm Design for Neural Spike Detection, Feature Extraction, and Dimensionality Reduction , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Dejan Markovic,et al.  Comparison of spike-sorting algorithms for future hardware implementation , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Xiaoli Li,et al.  Suppressing epileptic activity in a neural mass model using a closed-loop proportional-integral controller , 2016, Scientific Reports.

[24]  W. Liu,et al.  A 128-Channel 6 mW Wireless Neural Recording IC With Spike Feature Extraction and UWB Transmitter , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  Yueming Wang,et al.  Optogenetic control of thalamus as a tool for interrupting penicillin induced seizures , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[26]  Andreas Hierlemann,et al.  Complexity Optimization and High-Throughput Low-Latency Hardware Implementation of a Multi-Electrode Spike-Sorting Algorithm , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  Christiane Thielemann,et al.  A novel automated spike sorting algorithm with adaptable feature extraction , 2012, Journal of Neuroscience Methods.

[28]  Jean Rouat,et al.  Unsupervised Spike Sorting of extracellular electrophysiological recording in subthalamic nucleus of Parkinsonian patients. , 2005, Bio Systems.

[29]  Qi Zhao,et al.  Noise Characterization, Modeling, and Reduction for In Vivo Neural Recording , 2009, NIPS.

[30]  Eytan Domany,et al.  Data Clustering Using a Model Granular Magnet , 1997, Neural Computation.

[31]  Igor V Tetko,et al.  An unsupervised automatic method for sorting neuronal spike waveforms in awake and freely moving animals. , 2003, Methods.

[32]  Romain Brette,et al.  Handbook of neural activity measurement , 2012 .

[33]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  C. Koch,et al.  Biophysics of Extracellular Spikes , 2013 .

[35]  Rodrigo Quian Quiroga,et al.  Past, present and future of spike sorting techniques , 2015, Brain Research Bulletin.

[36]  Sung June Kim,et al.  A wavelet-based method for action potential detection from extracellular neural signal recording with low signal-to-noise ratio , 2003, IEEE Transactions on Biomedical Engineering.

[37]  Chao Liu,et al.  Computationally inexpensive enhanced growing neural gas algorithm for real-time adaptive neural spike clustering , 2019, Journal of neural engineering.

[38]  R. Swendsen,et al.  Cluster Monte Carlo algorithms , 1990 .

[39]  Joe Z. Tsien,et al.  Cre-Lox Neurogenetics: 20 Years of Versatile Applications in Brain Research and Counting… , 2016, Front. Genet..

[40]  D. Humphrey,et al.  Extracellular Single-Unit Recording Methods , 1990 .

[41]  Jie Zhang,et al.  Peak detection on ChIP-Seq data using wavelet transformation , 2010, 2010 IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW).

[42]  Andrew Jackson,et al.  Minimum requirements for accurate and efficient real-time on-chip spike sorting , 2014, Journal of Neuroscience Methods.

[43]  Karl Deisseroth,et al.  Closed-Loop and Activity-Guided Optogenetic Control , 2015, Neuron.

[44]  Klaus Obermayer,et al.  Bayes optimal template matching for spike sorting – combining fisher discriminant analysis with optimal filtering , 2015, Journal of Computational Neuroscience.

[45]  Ueli Rutishauser,et al.  Online detection and sorting of extracellularly recorded action potentials in human medial temporal lobe recordings, in vivo , 2006, Journal of Neuroscience Methods.

[46]  Andrew P. Bradley,et al.  A Parametric Simulation of Neuronal Noise From Microelectrode Recordings , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[47]  D. Restrepo,et al.  Behavioral Status Influences the Dependence of Odorant-Induced Change in Firing on Prestimulus Firing Rate , 2017, The Journal of Neuroscience.

[48]  U. Wolff Comparison Between Cluster Monte Carlo Algorithms in the Ising Model , 1989 .

[49]  Tim C. Lei,et al.  Light Scattering Properties Vary across Different Regions of the Adult Mouse Brain , 2013, PloS one.

[50]  Cyrille Rossant,et al.  Spike sorting for large, dense electrode arrays , 2015 .

[51]  Sung June Kim,et al.  Neural spike sorting under nearly 0-dB signal-to-noise ratio using nonlinear energy operator and artificial neural-network classifier , 2000, IEEE Transactions on Biomedical Engineering.

[52]  A. Wickenden Overview of Electrophysiological Techniques , 2000, Current protocols in pharmacology.

[53]  K. Deisseroth,et al.  Optogenetic investigation of neural circuits underlying brain disease in animal models , 2012, Nature Reviews Neuroscience.

[54]  Michael Steven Williams Electrophysiological Techniques , 2007 .

[55]  Agnès Gruart,et al.  Spike sorting based on shape, phase, and distribution features, and K-TOPS clustering with validity and error indices , 2018, Scientific Reports.

[56]  J. Pillow,et al.  Lipopolysaccharide-Induced Weakness in the Preterm Diaphragm Is Associated with Mitochondrial Electron Transport Chain Dysfunction and Oxidative Stress , 2013, PloS one.

[57]  Sergey L. Gratiy,et al.  Real-time spike sorting platform for high-density extracellular probes with ground-truth validation and drift correction , 2017, bioRxiv.

[58]  Daniel N Hill,et al.  Quality Metrics to Accompany Spike Sorting of Extracellular Signals , 2011, The Journal of Neuroscience.

[59]  Kenneth D. Harris,et al.  High-Dimensional Cluster Analysis with the Masked EM Algorithm , 2013, Neural Computation.

[60]  John L. Semmlow,et al.  Biosignal and biomedical image processing : MATLAB-based applications , 2004 .

[61]  Tomoki Fukai,et al.  Accurate spike sorting for multi‐unit recordings , 2010, The European journal of neuroscience.

[62]  M S Lewicki,et al.  A review of methods for spike sorting: the detection and classification of neural action potentials. , 1998, Network.

[63]  Chao Liu,et al.  Data reduction for real-time enhanced growing neural gas spike sorting with multiple recording channels , 2019, 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER).

[64]  Blatt,et al.  Superparamagnetic clustering of data. , 1998, Physical review letters.

[65]  Peng Un Mak,et al.  Circuit Models and Experimental Noise Measurements of Micropipette Amplifiers for Extracellular Neural Recordings from Live Animals , 2014, BioMed research international.

[66]  Julien Fournier,et al.  Consensus-Based Sorting of Neuronal Spike Waveforms , 2016, PloS one.

[67]  Tomoki Fukai,et al.  Spike sorting of heterogeneous neuron types by multimodality-weighted PCA and explicit robust variational Bayes , 2012, Front. Neuroinform..

[68]  Pui-In Mak,et al.  An Integrated Circuit for Simultaneous Extracellular Electrophysiology Recording and Optogenetic Neural Manipulation , 2017, IEEE Transactions on Biomedical Engineering.

[69]  Vaibhav Karkare,et al.  A 75-µW, 16-Channel Neural Spike-Sorting Processor With Unsupervised Clustering , 2011, IEEE Journal of Solid-State Circuits.

[70]  S. Mukhopadhyay,et al.  A new interpretation of nonlinear energy operator and its efficacy in spike detection , 1998, IEEE Transactions on Biomedical Engineering.