Kernel density compression for real-time Bayesian encoding/decoding of unsorted hippocampal spikes

Abstract To gain a better understanding of how neural ensembles communicate and process information, neural decoding algorithms are used to extract information encoded in their spiking activity. Bayesian decoding is one of the most used neural population decoding approaches to extract information from the ensemble spiking activity of rat hippocampal neurons. Recently it has been shown how Bayesian decoding can be implemented without the intermediate step of sorting spike waveforms into groups of single units. Here we extend the approach in order to make it suitable for online encoding/decoding scenarios that require real-time decoding such as brain-machine interfaces. We propose an online algorithm for the Bayesian decoding that reduces the time required for decoding neural populations, resulting in a real-time capable decoding framework. More specifically, we improve the speed of the probability density estimation step, which is the most essential and the most expensive computation of the spike-sorting-less decoding process, by developing a kernel density compression algorithm. In contrary to existing online kernel compression techniques, rather than optimizing for the minimum estimation error caused by kernels compression, the proposed method compresses kernels on the basis of the distance between the merging component and its most similar neighbor. Thus, without costly optimization, the proposed method has very low compression latency with a small and manageable estimation error. In addition, the proposed bandwidth matching method for Gaussian kernels merging has an interesting mathematical property whereby optimization in the estimation of the probability density function can be performed efficiently, resulting in a faster decoding speed. We successfully applied the proposed kernel compression algorithm to the Bayesian decoding framework to reconstruct positions of a freely moving rat from hippocampal unsorted spikes, with significant improvements in the decoding speed and acceptable decoding error.

[1]  Matej Kristan Multivariate Online Kernel Density Estimation , 2010 .

[2]  Emilio Salinas,et al.  Vector reconstruction from firing rates , 1994, Journal of Computational Neuroscience.

[3]  Andrew W. Moore,et al.  Nonparametric Density Estimation: Toward Computational Tractability , 2003, SDM.

[4]  Valérie Ventura,et al.  Spike Train Decoding Without Spike Sorting , 2008, Neural Computation.

[5]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. II. Coding of the direction of movement by a neuronal population , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  Hisao Ishibuchi,et al.  Dm-KDE: dynamical kernel density estimation by sequences of KDE estimators with fixed number of components over data streams , 2014, Frontiers of Computer Science.

[7]  Bernhard Seeger,et al.  Cluster Kernels: Resource-Aware Kernel Density Estimators over Streaming Data , 2008, IEEE Trans. Knowl. Data Eng..

[8]  Masayuki Numao,et al.  Concept Drift Detection with Clustering via Statistical Change Detection Methods , 2015, 2015 Seventh International Conference on Knowledge and Systems Engineering (KSE).

[9]  Bernhard Seeger,et al.  Towards Kernel Density Estimation over Streaming Data , 2006, COMAD.

[10]  Robert E. Kass,et al.  Statistical Signal Processing and the Motor Cortex , 2007, Proceedings of the IEEE.

[11]  Matthew A. Wilson,et al.  Hippocampal Replay of Extended Experience , 2009, Neuron.

[12]  Bernhard Seeger,et al.  Cluster Kernels: Resource-Aware Kernel Density Estimators over Streaming Data , 2006, IEEE Transactions on Knowledge and Data Engineering.

[13]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[14]  Matthew A. Wilson,et al.  Micro-drive Array for Chronic in vivo Recording: Drive Fabrication , 2009, Journal of visualized experiments : JoVE.

[15]  R E Kass,et al.  Recursive bayesian decoding of motor cortical signals by particle filtering. , 2004, Journal of neurophysiology.

[16]  D. W. Scott,et al.  Kernel density estimation with binned data , 1985 .

[17]  Michael J. Black,et al.  Closed-loop neural control of cursor motion using a Kalman filter , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  J Bures,et al.  Place cells and place navigation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[19]  B. Silverman,et al.  Kernel Density Estimation Using the Fast Fourier Transform , 1982 .

[20]  B. Silverman,et al.  Algorithm AS 176: Kernel Density Estimation Using the Fast Fourier Transform , 1982 .

[21]  Matthew Fellows,et al.  Statistical encoding model for a primary motor cortical brain-machine interface , 2005, IEEE Transactions on Biomedical Engineering.

[22]  Octavia I. Camps,et al.  Weighted Parzen Windows for Pattern Classification , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  James T. Kwok,et al.  Simplifying Mixture Models Through Function Approximation , 2006, IEEE Transactions on Neural Networks.

[24]  R. Quiroga,et al.  Extracting information from neuronal populations : information theory and decoding approaches , 2022 .

[25]  Haibo He,et al.  SOMKE: Kernel Density Estimation Over Data Streams by Sequences of Self-Organizing Maps , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Rajendra Akerkar,et al.  Knowledge Based Systems , 2017, Encyclopedia of GIS.

[27]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[28]  J. O’Neill,et al.  Play it again: reactivation of waking experience and memory , 2010, Trends in Neurosciences.

[29]  A.R. Runnalls,et al.  A Kullback-Leibler Approach to Gaussian Mixture Reduction , 2007 .

[30]  Feifei Li,et al.  Quality and efficiency for kernel density estimates in large data , 2013, SIGMOD '13.

[31]  Shai Ben-David,et al.  Detecting Change in Data Streams , 2004, VLDB.

[32]  M S Lewicki,et al.  A review of methods for spike sorting: the detection and classification of neural action potentials. , 1998, Network.

[33]  Eran Stark,et al.  Predicting Movement from Multiunit Activity , 2007, The Journal of Neuroscience.

[34]  Maria V. Sanchez-Vives,et al.  Source (or Part of the following Source): Type Article Title Real-time Position Reconstruction with Hippocampal Place Cells. Author(s) Real-time Position Reconstruction with Hippocampal Place Cells , 2022 .

[35]  Arnold P. Boedihardjo,et al.  Fast adaptive kernel density estimator for data streams , 2013, Knowledge and Information Systems.

[36]  Fabian Kloosterman,et al.  Bayesian decoding using unsorted spikes in the rat hippocampus. , 2014, Journal of neurophysiology.

[37]  Don H. Johnson,et al.  Information theoretic bounds on neural prosthesis effectiveness: The importance of spike sorting , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[38]  Ales Leonardis,et al.  Online Discriminative Kernel Density Estimator With Gaussian Kernels , 2014, IEEE Transactions on Cybernetics.

[39]  Liam Paninski,et al.  Statistical models for neural encoding, decoding, and optimal stimulus design. , 2007, Progress in brain research.

[40]  Li Wei,et al.  M-kernel merging: towards density estimation over data streams , 2003, Eighth International Conference on Database Systems for Advanced Applications, 2003. (DASFAA 2003). Proceedings..

[41]  B L McNaughton,et al.  Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. , 1998, Journal of neurophysiology.

[42]  L. Holmström,et al.  The Accuracy and the Computational Complexity of a Multivariate Binned Kernel Density Estimator , 2000 .

[43]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[44]  Matthew A. Wilson,et al.  Dynamic Analyses of Information Encoding in Neural Ensembles , 2004, Neural Computation.

[45]  E N Brown,et al.  A Statistical Paradigm for Neural Spike Train Decoding Applied to Position Prediction from Ensemble Firing Patterns of Rat Hippocampal Place Cells , 1998, The Journal of Neuroscience.

[46]  Ludmila I. Kuncheva,et al.  Change Detection in Streaming Multivariate Data Using Likelihood Detectors , 2013, IEEE Transactions on Knowledge and Data Engineering.

[47]  David A. Landgrebe,et al.  Fast Parzen Density Estimation Using Clustering-Based Branch and Bound , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  A B Schwartz,et al.  Motor cortical representation of speed and direction during reaching. , 1999, Journal of neurophysiology.

[49]  T. Sanger,et al.  Probability density estimation for the interpretation of neural population codes. , 1996, Journal of neurophysiology.