Deep compressive autoencoder for action potential compression in large-scale neural recording

OBJECTIVE Understanding the coordinated activity underlying brain computations requires large-scale, simultaneous recordings from distributed neuronal structures at a cellular-level resolution. One major hurdle to design high-bandwidth, high-precision, large-scale neural interfaces lies in the formidable data streams (tens to hundreds of Gbps) that are generated by the recorder chip and need to be online transferred to a remote computer. The data rates can require hundreds to thousands of I/O pads on the recorder chip and power consumption on the order of Watts for data streaming alone. One of the solutions is to reduce the bandwidth of neural signals before transmission. APPROACH We developed a deep learning-based compression model to reduce the data rate of multichannel action potentials. The proposed compression model is built upon a deep compressive autoencoder (CAE) with discrete latent embeddings. The encoder network of CAE is equipped with residual transformations to extract representative features from spikes, which are mapped into the latent embedding space and updated via vector quantization (VQ). The indexes of VQ codebook are further entropy coded as the compressed signals. The decoder network reconstructs spike waveforms with high quality from the quantized latent embeddings through stacked deconvolution. MAIN RESULTS Extensive experimental results on both synthetic and in vivo datasets show that the proposed model consistently outperforms conventional methods that utilize hand-crafted features and/or signal-agnostic transformations and compressive sensing by achieving much higher compression ratios (20-500×) and better or comparable reconstruction accuracies. Testing results also indicate that CAE is robust against a diverse range of imperfections, such as waveform variation and spike misalignment, and has minor influence on spike sorting accuracy. Furthermore, we have estimated the hardware cost and real-time performance of CAE and shown that it could support thousands of recording channels simultaneously without excessive power/heat dissipation. SIGNIFICANCE The proposed model can reduce the required data transmission bandwidth in large-scale recording experiments and maintain good signal qualities, which will be helpful to design power-efficient and lightweight wireless neural interfaces. We have open sourced the code implementation of the work at https://github.com/tong-wu-umn/spike-compression-autoencoder.

[1]  Wenfeng Zhao,et al.  A Streaming PCA VLSI Chip for Neural Data Compression , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[2]  Jian Xu,et al.  A nonparametric neural signal processor for online data compression and power management , 2015, 2015 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[3]  Athanassios G. Siapas,et al.  Model-based spike sorting with a mixture of drifting t-distributions , 2017, Journal of Neuroscience Methods.

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Ralph Etienne-Cummings,et al.  A closed-loop compressive-sensing-based neural recording system , 2015, Journal of neural engineering.

[6]  Amir M. Sodagar,et al.  Data Compression in Brain-Machine/Computer Interfaces Based on the Walsh–Hadamard Transform , 2014, IEEE Transactions on Biomedical Circuits and Systems.

[7]  Moo Sung Chae,et al.  A 128-Channel 6mW Wireless Neural Recording IC with On-the-Fly Spike Sorting and UWB Tansmitter , 2008, 2008 IEEE International Solid-State Circuits Conference - Digest of Technical Papers.

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Mohamad Sawan,et al.  A Mixed-Signal Multichip Neural Recording Interface With Bandwidth Reduction , 2009, IEEE Transactions on Biomedical Circuits and Systems.

[10]  Oriol Vinyals,et al.  Neural Discrete Representation Learning , 2017, NIPS.

[11]  Refet Firat Yazicioglu,et al.  22.7 A 966-electrode neural probe with 384 configurable channels in 0.13µm SOI CMOS , 2016, 2016 IEEE International Solid-State Circuits Conference (ISSCC).

[12]  Jie Zhang,et al.  Communication Channel Analysis and Real Time Compressed Sensing for High Density Neural Recording Devices , 2016, IEEE Transactions on Circuits and Systems I: Regular Papers.

[13]  R. Wm Thermal Considerations for the Design of an Implanted Cortical Brain–Machine Interface (BMI) -- Indwelling Neural Implants: Strategies for Contending with the In Vivo Environment , 2008 .

[14]  R. Quian Quiroga,et al.  Unsupervised Spike Detection and Sorting with Wavelets and Superparamagnetic Clustering , 2004, Neural Computation.

[15]  Kenneth D. Harris,et al.  Fast and accurate spike sorting of high-channel count probes with KiloSort , 2016, NIPS.

[16]  S Craciun,et al.  Wireless Transmission of Neural Signals Using Entropy and Mutual Information Compression , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Pramod Kanjalkar,et al.  The comparison of different transform based methods for ECG data compression , 2011, 2011 International Conference on Signal Processing, Communication, Computing and Networking Technologies.

[18]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[19]  Vivienne Sze,et al.  Efficient Processing of Deep Neural Networks: A Tutorial and Survey , 2017, Proceedings of the IEEE.

[20]  Dejan Markovic,et al.  Spike Sorting: The First Step in Decoding the Brain: The first step in decoding the brain , 2012, IEEE Signal Processing Magazine.

[21]  Wenfeng Zhao,et al.  Training-free compressed sensing for wireless neural recording using analysis model and group weighted ℓ1-minimization , 2017, 2016 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[22]  Wenfeng Zhao,et al.  On-Chip Neural Data Compression Based On Compressed Sensing With Sparse Sensing Matrices , 2018, IEEE Transactions on Biomedical Circuits and Systems.

[23]  Eran Stark,et al.  Large-scale, high-density (up to 512 channels) recording of local circuits in behaving animals. , 2014, Journal of neurophysiology.

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[25]  Jian Xu,et al.  A Frequency Shaping Neural Recorder With 3 pF Input Capacitance and 11 Plus 4.5 Bits Dynamic Range , 2014, IEEE Transactions on Biomedical Circuits and Systems.

[26]  Konrad P Kording,et al.  How advances in neural recording affect data analysis , 2011, Nature Neuroscience.

[27]  Zhi Yang,et al.  Neuronix enables continuous, simultaneous neural recording and electrical microstimulation. , 2016, Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference.

[28]  D. Markovic,et al.  A 130-μW, 64-channel spike-sorting DSP chip , 2009, 2009 IEEE Asian Solid-State Circuits Conference.

[29]  Sergey L. Gratiy,et al.  Fully integrated silicon probes for high-density recording of neural activity , 2017, Nature.

[30]  Armand Joulin,et al.  Unsupervised Learning by Predicting Noise , 2017, ICML.

[31]  Michele Rossi,et al.  On the Performance of Lossy Compression Schemes for Energy Constrained Sensor Networking , 2014, TOSN.

[32]  Valero Laparra,et al.  End-to-end Optimized Image Compression , 2016, ICLR.

[33]  Awais M. Kamboh,et al.  A Scalable Wavelet Transform VLSI Architecture for Real-Time Signal Processing in High-Density Intra-Cortical Implants , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.

[34]  David Tsai,et al.  High-channel-count, high-density microelectrode array for closed-loop investigation of neuronal networks , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[35]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[36]  Serge J. Belongie,et al.  Residual Networks Behave Like Ensembles of Relatively Shallow Networks , 2016, NIPS.

[37]  Ronen Tamari,et al.  Boosting Dilated Convolutional Networks with Mixed Tensor Decompositions , 2017, ICLR.

[38]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Amir M. Sodagar,et al.  A Method for Compression of Intra-Cortically-Recorded Neural Signals Dedicated to Implantable Brain–Machine Interfaces , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[40]  Lucas Theis,et al.  Lossy Image Compression with Compressive Autoencoders , 2017, ICLR.

[41]  B. McNaughton,et al.  Tetrodes markedly improve the reliability and yield of multiple single-unit isolation from multi-unit recordings in cat striate cortex , 1995, Journal of Neuroscience Methods.

[42]  J. Csicsvari,et al.  Accuracy of tetrode spike separation as determined by simultaneous intracellular and extracellular measurements. , 2000, Journal of neurophysiology.

[43]  T. Insel,et al.  The NIH BRAIN Initiative , 2013, Science.

[44]  J. Csicsvari,et al.  Intracellular features predicted by extracellular recordings in the hippocampus in vivo. , 2000, Journal of neurophysiology.

[45]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Jian Xu,et al.  A 16-Channel Nonparametric Spike Detection ASIC Based on EC-PC Decomposition , 2016, IEEE Transactions on Biomedical Circuits and Systems.