A study of autoencoders as a feature extraction technique for spike sorting

Spike sorting is the process of grouping spikes of distinct neurons into their respective clusters. Most frequently, this grouping is performed by relying on the similarity of features extracted from spike shapes. In spite of recent developments, current methods have yet to achieve satisfactory performance and many investigators favour sorting manually, even though it is an intensive undertaking that requires prolonged allotments of time. To automate the process, a diverse array of machine learning techniques has been applied. The performance of these techniques depends however critically on the feature extraction step. Here, we propose deep learning using autoencoders as a feature extraction method and evaluate extensively the performance of multiple designs. The models presented are evaluated on publicly available synthetic and real “in vivo” datasets, with various numbers of clusters. The proposed methods indicate a higher performance for the process of spike sorting when compared to other state-of-the-art techniques.

[1]  M. Dehaqani,et al.  An automatic spike sorting algorithm based on adaptive spike detection and a mixture of skew-t distributions , 2021, Scientific Reports.

[2]  Ahmad Asgharian Rezaei,et al.  Online spike sorting via deep contractive autoencoder , 2021, bioRxiv.

[3]  Thomas Bonald,et al.  Pairwise Adjusted Mutual Information , 2021, ArXiv.

[4]  Phan-Minh Nguyen,et al.  Analysis of feature learning in weight-tied autoencoders via the mean field lens , 2021, ArXiv.

[5]  Dosik Hwang,et al.  Deep-learned spike representations and sorting via an ensemble of auto-encoders , 2020, Neural Networks.

[6]  Pawel Ksieniewicz,et al.  Application of Imbalanced Data Classification Quality Metrics as Weighting Methods of the Ensemble Data Stream Classification Algorithms , 2020, Entropy.

[7]  Asim Bhatti,et al.  Compatibility Evaluation of Clustering Algorithms for Contemporary Extracellular Neural Spike Sorting , 2020, Frontiers in Systems Neuroscience.

[8]  Alaa Sagheer,et al.  Unsupervised Pre-training of a Deep LSTM-based Stacked Autoencoder for Multivariate Time Series Forecasting Problems , 2019, Scientific Reports.

[9]  J. Delgado-García,et al.  Spike sorting based on shape, phase, and distribution features, and K-TOPS clustering with validity and error indices , 2018, Scientific Reports.

[10]  Feng Wang,et al.  t-Distributed Stochastic Neighbor Embedding Method with the Least Information Loss for Macromolecular Simulations. , 2018, Journal of chemical theory and computation.

[11]  Sergey L. Gratiy,et al.  Fully integrated silicon probes for high-density recording of neural activity , 2017, Nature.

[12]  Jeremy F. Magland,et al.  A Fully Automated Approach to Spike Sorting , 2017, Neuron.

[13]  L. Berdondini,et al.  Intracellular and Extracellular Recording of Spontaneous Action Potentials in Mammalian Neurons and Cardiac Cells with 3D Plasmonic Nanoelectrodes , 2017, Nano letters.

[14]  R. Kempter,et al.  Cell Type-Specific Differences in Spike Timing and Spike Shape in the Rat Parasubiculum and Superficial Medial Entorhinal Cortex , 2016, Cell reports.

[15]  Matteo Carandini,et al.  Kilosort: realtime spike-sorting for extracellular electrophysiology with hundreds of channels , 2016, bioRxiv.

[16]  Hongxun Yao,et al.  Auto-encoder based dimensionality reduction , 2016, Neurocomputing.

[17]  Rodrigo Quian Quiroga,et al.  Past, present and future of spike sorting techniques , 2015, Brain Research Bulletin.

[18]  Wei Wang,et al.  Generalized Autoencoder: A Neural Network Framework for Dimensionality Reduction , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[19]  E. Santana,et al.  ICA feature extraction for spike sorting of single-channel records , 2013, 2013 ISSNIP Biosignals and Biorobotics Conference: Biosignals and Robotics for Better and Safer Living (BRC).

[20]  Aapo Hyvärinen,et al.  Independent component analysis: recent advances , 2013, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[21]  Z Tiganj,et al.  Neural spike sorting using iterative ICA and a deflation-based approach , 2012, Journal of neural engineering.

[22]  Rodrigo Quian Quiroga,et al.  How many neurons can we see with current spike sorting algorithms? , 2012, Journal of Neuroscience Methods.

[23]  Chenhui Yang,et al.  The M-Sorter: An automatic and robust spike detection and classification system , 2012, Journal of Neuroscience Methods.

[24]  R. Quiroga Spike sorting , 2012, Current Biology.

[25]  Pierre Baldi,et al.  Autoencoders, Unsupervised Learning, and Deep Architectures , 2011, ICML Unsupervised and Transfer Learning.

[26]  Pascal Vincent,et al.  Contractive Auto-Encoders: Explicit Invariance During Feature Extraction , 2011, ICML.

[27]  Konrad P Kording,et al.  How advances in neural recording affect data analysis , 2011, Nature Neuroscience.

[28]  James Bailey,et al.  Information Theoretic Measures for Clusterings Comparison: Variants, Properties, Normalization and Correction for Chance , 2010, J. Mach. Learn. Res..

[29]  James Bailey,et al.  Information theoretic measures for clusterings comparison: is a correction for chance necessary? , 2009, ICML '09.

[30]  Andrew K. C. Wong,et al.  Classification of Imbalanced Data: a Review , 2009, Int. J. Pattern Recognit. Artif. Intell..

[31]  Dimitrios A. Adamos,et al.  Performance evaluation of PCA-based spike sorting algorithms , 2008, Comput. Methods Programs Biomed..

[32]  Julia Hirschberg,et al.  V-Measure: A Conditional Entropy-Based External Cluster Evaluation Measure , 2007, EMNLP.

[33]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[34]  D. Steinley Properties of the Hubert-Arabie adjusted Rand index. , 2004, Psychological methods.

[35]  Gary M. Weiss Mining with rarity: a unifying framework , 2004, SKDD.

[36]  Joydeep Ghosh,et al.  Cluster Ensembles --- A Knowledge Reuse Framework for Combining Multiple Partitions , 2002, J. Mach. Learn. Res..

[37]  Gilles Laurent,et al.  Using noise signature to optimize spike-sorting and to assess neuronal classification quality , 2002, Journal of Neuroscience Methods.

[38]  R. Segev,et al.  A method for spike sorting and detection based on wavelet packets and Shannon's mutual information , 2002, Journal of Neuroscience Methods.

[39]  Michalis Vazirgiannis,et al.  On Clustering Validation Techniques , 2001, Journal of Intelligent Information Systems.

[40]  Vipin Kumar,et al.  Evaluating boosting algorithms to classify rare classes: comparison and improvements , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[41]  Moni Naor,et al.  Rank aggregation methods for the Web , 2001, WWW '01.

[42]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[43]  M S Lewicki,et al.  A review of methods for spike sorting: the detection and classification of neural action potentials. , 1998, Network.

[44]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[45]  Richard G. Lyons,et al.  Understanding Digital Signal Processing , 1996 .

[46]  Markus Meister,et al.  Multi-neuronal signals from the retina: acquisition and analysis , 1994, Journal of Neuroscience Methods.

[47]  M. Salganicoff,et al.  Unsupervised waveform classification for multi-neuron recordings: a real-time, software-based system. I. Algorithms and implementation , 1988, Journal of Neuroscience Methods.

[48]  M. F. Sarna,et al.  Unsupervised waveform classification for multi-neuron recordings: a real-time, software-based system. II. Performance comparison to other sorters , 1988, Journal of Neuroscience Methods.

[49]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[50]  C. Mallows,et al.  A Method for Comparing Two Hierarchical Clusterings , 1983 .

[51]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  M. Abeles,et al.  Multispike train analysis , 1977, Proceedings of the IEEE.

[53]  Sheng Huang,et al.  Clustering With Orthogonal AutoEncoder , 2019, IEEE Access.

[54]  Aboul Ella Hassanien,et al.  Linear discriminant analysis: A detailed tutorial , 2017, AI Commun..

[55]  Justin C. Strickland,et al.  Guide to Research Techniques in Neuroscience , 2014 .

[56]  Eréndira Rendón,et al.  Internal versus External cluster validation indexes , 2011 .

[57]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[58]  G. Buzsáki Rhythms of the brain , 2006 .

[59]  A.M. Litke,et al.  What does the eye tell the brain?: Development of a system for the large scale recording of retinal output activity , 2003, 2003 IEEE Nuclear Science Symposium. Conference Record (IEEE Cat. No.03CH37515).

[60]  L. Hubert,et al.  Comparing partitions , 1985 .

[61]  T. Caliński,et al.  A dendrite method for cluster analysis , 1974 .

[62]  E. M. Glaser,et al.  ON-LINE SEPARATION OF INTERLEAVED NEURONAL PULSE SEQUENCES* , 1968 .

[63]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .