SpikeDeeptector: a deep-learning based method for detection of neural spiking activity

OBJECTIVE In electrophysiology, microelectrodes are the primary source for recording neural data (single unit activity). These microelectrodes can be implanted individually or in the form of arrays containing dozens to hundreds of channels. Recordings of some channels contain neural activity, which are often contaminated with noise. Another fraction of channels does not record any neural data, but only noise. By noise, we mean physiological activities unrelated to spiking, including technical artifacts and neural activities of neurons that are too far away from the electrode to be usefully processed. For further analysis, an automatic identification and continuous tracking of channels containing neural data is of great significance for many applications, e.g. automated selection of neural channels during online and offline spike sorting. Automated spike detection and sorting is also critical for online decoding in brain-computer interface (BCI) applications, in which only simple threshold crossing events are often considered for feature extraction. To our knowledge, there is no method that can universally and automatically identify channels containing neural data. In this study, we aim to identify and track channels containing neural data from implanted electrodes, automatically and more importantly universally. By universally, we mean across different recording technologies, different subjects and different brain areas. APPROACH We propose a novel algorithm based on a new way of feature vector extraction and a deep learning method, which we call SpikeDeeptector. SpikeDeeptector considers a batch of waveforms to construct single feature vector and enables contextual learning. The feature vectors are then fed to a deep learning method, which learns contextualized, temporal and spatial patterns, and classifies them as channels containing neural spike data or only noise. MAIN RESULTS We trained the model of SpikeDeeptector on data recorded from a single tetraplegic patient with two Utah arrays implanted in different areas of the brain. The trained model was then evaluated on data collected from six epileptic patients implanted with depth electrodes, unseen data from the tetraplegic patient and data from another tetraplegic patient implanted with two Utah arrays. The cumulative evaluation accuracy was 97.20 % on 1.56 million hand labeled test inputs. SIGNIFICANCE The results demonstrate that SpikeDeeptector generalizes not only to the new data, but also to different brain areas, subjects, and electrode types not used for training.

[1]  Kenneth D. Harris,et al.  High-Dimensional Cluster Analysis with the Masked EM Algorithm , 2013, Neural Computation.

[2]  Daniel Micol,et al.  Nev2lkit: a New Open Source Tool for Handling neuronal Event Files from Multi-electrode recordings , 2014, Int. J. Neural Syst..

[3]  Jeremy F. Magland,et al.  A Fully Automated Approach to Spike Sorting , 2017, Neuron.

[4]  Ali Ghazizadeh,et al.  A fully automated spike sorting algorithm using t-distributed neighbor embedding and density based clustering , 2018 .

[5]  Cyrille Rossant,et al.  Spike sorting for large, dense electrode arrays , 2015 .

[6]  E. Fetz,et al.  Volitional control of single cortical neurons in a brain–machine interface , 2011, Journal of neural engineering.

[7]  Shie Mannor,et al.  The cross entropy method for classification , 2005, ICML.

[8]  Mikhail A. Lebedev,et al.  How to read neuron-dropping curves? , 2014, Front. Syst. Neurosci..

[9]  Ning Qian,et al.  On the momentum term in gradient descent learning algorithms , 1999, Neural Networks.

[10]  M. Abeles,et al.  Multispike train analysis , 1977, Proceedings of the IEEE.

[11]  Michael J. Berry,et al.  Mapping a Complete Neural Population in the Retina , 2012, The Journal of Neuroscience.

[12]  Linh Hoang,et al.  1/f Neural Noise Reduction and Spike Feature Extraction Using a Subset of Informative Samples , 2010, Annals of Biomedical Engineering.

[13]  Tomoki Fukai,et al.  Spike sorting of heterogeneous neuron types by multimodality-weighted PCA and explicit robust variational Bayes , 2012, Front. Neuroinform..

[14]  Daniel N Hill,et al.  Quality Metrics to Accompany Spike Sorting of Extracellular Signals , 2011, The Journal of Neuroscience.

[15]  Valérie Ventura,et al.  To sort or not to sort: the impact of spike-sorting on neural decoding performance , 2014, Journal of neural engineering.

[16]  Andrew B Schwartz,et al.  Cortical neural prosthetics. , 2004, Annual review of neuroscience.

[17]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[18]  Gregory Apker,et al.  Multimodal representation of limb endpoint position in the posterior parietal cortex. , 2013, Journal of neurophysiology.

[19]  Gerhard Gritsch,et al.  F08. Automatic spike detection in intracerebral depth electrode recordings , 2018, Clinical Neurophysiology.

[20]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[21]  M. Spira,et al.  Multi-electrode array technologies for neuroscience and cardiology. , 2013, Nature nanotechnology.

[22]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[23]  Rodrigo Quian Quiroga,et al.  Past, present and future of spike sorting techniques , 2015, Brain Research Bulletin.

[24]  R. Wightman,et al.  Microelectrodes for studying neurobiology. , 2008, Current opinion in chemical biology.

[25]  E. Wanke,et al.  Exact distinction of excitatory and inhibitory neurons in neural networks: a study with GFP-GAD67 neurons optically and electrophysiologically recognized on multielectrode arrays , 2012, Front. Neural Circuits.

[26]  Tony A. Fields,et al.  Cerebral microdialysis combined with single-neuron and electroencephalographic recording in neurosurgical patients. Technical note. , 1999, Journal of neurosurgery.

[27]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[28]  Geoffrey E. Hinton,et al.  Learning representations by back-propagation errors, nature , 1986 .

[29]  M S Lewicki,et al.  A review of methods for spike sorting: the detection and classification of neural action potentials. , 1998, Network.

[30]  José Carlos Príncipe,et al.  Ascertaining the importance of neurons to develop better brain-machine interfaces , 2004, IEEE Transactions on Biomedical Engineering.

[31]  Kenneth D Harris,et al.  Towards reliable spike-train recordings from thousands of neurons with multielectrodes , 2012, Current Opinion in Neurobiology.

[32]  Jiwen Dong,et al.  Simple convolutional neural network on image classification , 2017, 2017 IEEE 2nd International Conference on Big Data Analysis (ICBDA)(.

[33]  P. M. Horton,et al.  Spike sorting based upon machine learning algorithms (SOMA) , 2007, Journal of Neuroscience Methods.

[34]  Mark A. Clements,et al.  Spike Sorting by Joint Probabilistic Modeling of Neural Spike Trains and Waveforms , 2014, Comput. Intell. Neurosci..

[35]  U. Frey,et al.  Microelectronic system for high-resolution mapping of extracellular electric fields applied to brain slices. , 2009, Biosensors & bioelectronics.

[36]  Dejan Markovic,et al.  Spike Sorting: The First Step in Decoding the Brain: The first step in decoding the brain , 2012, IEEE Signal Processing Magazine.

[37]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[38]  Steven M Chase,et al.  Control of a brain–computer interface without spike sorting , 2009, Journal of neural engineering.

[39]  Wei Chu,et al.  Multi-category Classification by Soft-Max Combination of Binary Classifiers , 2003, Multiple Classifier Systems.

[40]  R. Quiroga Concept cells: the building blocks of declarative memory functions , 2012, Nature Reviews Neuroscience.

[41]  Wen-Jyi Hwang,et al.  Spike Detection Based on Normalized Correlation with Automatic Template Generation , 2014, Sensors.

[42]  William S. Rhode,et al.  A neural network-based spike discriminator , 1994, Journal of Neuroscience Methods.

[43]  Yu Zeng,et al.  A Simple Deep Learning Method for Neuronal Spike Sorting , 2017 .

[44]  Eran Stark,et al.  Large-scale, high-density (up to 512 channels) recording of local circuits in behaving animals. , 2014, Journal of neurophysiology.

[45]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[46]  Timothy J. Blanche,et al.  Python for Large-Scale Electrophysiology , 2009, Front. Neuroinform..

[47]  Sunghan Kim,et al.  Automatic spike detection based on adaptive template matching for extracellular neural recordings , 2007, Journal of Neuroscience Methods.

[48]  Kenneth D Harris,et al.  Improving data quality in neuronal population recordings , 2016, Nature Neuroscience.

[49]  S. Herculano‐Houzel The Human Brain in Numbers: A Linearly Scaled-up Primate Brain , 2009, Front. Hum. Neurosci..

[50]  Xingyu Wang,et al.  Automatic spike detection based on real-time multi-channel template , 2011, 2011 4th International Conference on Biomedical Engineering and Informatics (BMEI).

[51]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[52]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[53]  Martin Vinck,et al.  Unsupervised clustering of temporal patterns in high-dimensional neuronal ensembles using a novel dissimilarity measure , 2018 .

[54]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[55]  Konrad P. Körding,et al.  Linear-nonlinear-time-warp-poisson models of neural activity , 2018, Journal of Computational Neuroscience.

[56]  Robert E. Kass,et al.  Comparison of brain–computer interface decoding algorithms in open-loop and closed-loop control , 2010, Journal of Computational Neuroscience.

[57]  Spencer Kellis,et al.  Hand Shape Representations in the Human Posterior Parietal Cortex , 2015, The Journal of Neuroscience.

[58]  Johannes Stallkamp,et al.  The German Traffic Sign Recognition Benchmark: A multi-class classification competition , 2011, The 2011 International Joint Conference on Neural Networks.

[59]  Anders Krogh,et al.  A Simple Weight Decay Can Improve Generalization , 1991, NIPS.

[60]  David B. Dunson,et al.  Multichannel Electrophysiological Spike Sorting via Joint Dictionary Learning and Mixture Modeling , 2013, IEEE Transactions on Biomedical Engineering.

[61]  R. Andersen,et al.  Decoding motor imagery from the posterior parietal cortex of a tetraplegic human , 2015, Science.

[62]  J. Yunus,et al.  Comparison of Brain-computer Interface Technology – Mode of Communication for the Locked , 2003 .

[63]  A. Lambacher,et al.  Identifying firing mammalian neurons in networks with high-resolution multi-transistor array (MTA) , 2011 .

[64]  Andrew Jackson,et al.  Minimum requirements for accurate and efficient real-time on-chip spike sorting , 2014, Journal of Neuroscience Methods.

[65]  Kenneth D. Harris,et al.  Fast and accurate spike sorting of high-channel count probes with KiloSort , 2016, NIPS.