Signal-to-signal neural networks for improved spike estimation from calcium imaging data

Spiking information of individual neurons is essential for functional and behavioral analysis in neuroscience research. Calcium imaging techniques are generally employed to obtain activities of neuronal populations. However, these techniques result in slowly-varying fluorescence signals with low temporal resolution. Estimating the temporal positions of the neuronal action potentials from these signals is a challenging problem. In the literature, several generative model-based and data-driven algorithms have been studied with varied levels of success. This article proposes a neural network-based signal-to-signal conversion approach, where it takes as input raw-fluorescence signal and learns to estimate the spike information in an end-to-end fashion. Theoretically, the proposed approach formulates the spike estimation as a single channel source separation problem with unknown mixing conditions. The source corresponding to the action potentials at a lower resolution is estimated at the output. Experimental studies on the spikefinder challenge dataset show that the proposed signal-to-signal conversion approach significantly outperforms state-of-the-art-methods in terms of Pearson’s correlation coefficient and Spearman’s rank correlation coefficient and yields comparable performance for the area under the receiver operating characteristics measure. We also show that the resulting system: (a) has low complexity with respect to existing supervised approaches and is reproducible; (b) is layer-wise interpretable; and (c) has the capability to generalize across different calcium indicators. Author summary Information processing by a population of neurons is studied using two-photon calcium imaging techniques. A neuronal spike results in an increased intracellular calcium concentration. Fluorescent calcium indicators change their brightness upon a change in the calcium concentration, and this change is captured in the imaging technique. The task of estimating the actual spike positions from the brightness variations is formally referred to as spike estimation. Several signal processing and machine learning-based algorithms have been proposed in the past to solve this problem. However, the task is still far from being solved. Here we present a novel neural network-based data-driven algorithm for spike estimation. Our method takes the fluorescence recording as the input and synthesizes the spike information signal, which is well-correlated with the actual spike positions. Our method outperforms state-of-the-art methods on standard evaluation framework. We further analyze different components of the model and discuss its benefits.

[1]  Matthias Bethge,et al.  Beyond GLMs: A Generative Mixture Modeling Approach to Neural System Identification , 2012, PLoS Comput. Biol..

[2]  Kenneth D. Harris,et al.  Community-based benchmarking improves spike rate inference from two-photon calcium imaging data , 2018, PLoS Comput. Biol..

[3]  Matthias Bethge,et al.  Information-theoretic model comparison unifies saliency metrics , 2015, Proceedings of the National Academy of Sciences.

[4]  D. Fitzpatrick,et al.  Three-dimensional mapping of microcircuit correlation structure , 2013, Front. Neural Circuits.

[5]  Jakob H. Macke,et al.  Fast amortized inference of neural activity from calcium imaging data with variational autoencoders , 2017, NIPS.

[6]  Thomas Serre,et al.  Learning to predict action potentials end-to-end from calcium imaging data , 2018, 2018 52nd Annual Conference on Information Sciences and Systems (CISS).

[7]  Shaoqun Zeng,et al.  Reconstruction of burst activity from calcium imaging of neuronal population via Lq minimization and interval screening. , 2016, Biomedical optics express.

[8]  Liam Paninski,et al.  Fast Active Set Methods for Online Spike Inference from Calcium Imaging , 2016, NIPS.

[9]  Stefan R. Pulver,et al.  Ultra-sensitive fluorescent proteins for imaging neuronal activity , 2013, Nature.

[10]  Liam Paninski,et al.  Bayesian spike inference from calcium imaging data , 2013, 2013 Asilomar Conference on Signals, Systems and Computers.

[11]  Amiram Grinvald,et al.  Accurate spike estimation from noisy calcium signals for ultrafast three-dimensional imaging of large neuronal populations in vivo , 2016, Nature Communications.

[12]  E. Yaksi,et al.  Reconstruction of firing rate changes across neuronal populations by temporally deconvolved Ca2+ imaging , 2006, Nature Methods.

[13]  W. Denk,et al.  Imaging in vivo: watching the brain in action , 2008, Nature Reviews Neuroscience.

[14]  James E. Fitzgerald,et al.  Photon shot noise limits on optical detection of neuronal spikes and estimation of spike timing. , 2013, Biophysical journal.

[15]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[16]  Mario Dipoppa,et al.  Suite2p: beyond 10,000 neurons with standard two-photon microscopy , 2016, bioRxiv.

[17]  Daniel Jiwoong Im,et al.  Importance Weighted Adversarial Variational Autoencoders for Spike Inference from Calcium Imaging Data , 2019, ArXiv.

[18]  Bowen Zhou,et al.  Abstractive Text Summarization using Sequence-to-sequence RNNs and Beyond , 2016, CoNLL.

[19]  Paul Fearnhead,et al.  Fast nonconvex deconvolution of calcium imaging data. , 2018, Biostatistics.

[20]  Travis E. Oliphant,et al.  Python for Scientific Computing , 2007, Computing in Science & Engineering.

[21]  Brendon O. Watson,et al.  Spike inference from calcium imaging using sequential Monte Carlo methods. , 2009, Biophysical journal.

[22]  Quoc V. Le,et al.  Listen, attend and spell: A neural network for large vocabulary conversational speech recognition , 2015, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[23]  Rafael Yuste,et al.  Fast nonnegative deconvolution for spike train inference from population calcium imaging. , 2009, Journal of neurophysiology.

[24]  Nima Mesgarani,et al.  TaSNet: Time-Domain Audio Separation Network for Real-Time, Single-Channel Speech Separation , 2017, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[25]  Yu Tsao,et al.  Raw waveform-based speech enhancement by fully convolutional networks , 2017, 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[26]  Liam Paninski,et al.  Fast online deconvolution of calcium imaging data , 2016, PLoS Comput. Biol..

[27]  Tara N. Sainath,et al.  State-of-the-Art Speech Recognition with Sequence-to-Sequence Models , 2017, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[28]  Jonah Casebeer,et al.  Adaptive Front-ends for End-to-end Source Separation , 2017 .

[29]  Norio Matsuki,et al.  Fast and accurate detection of action potentials from somatic calcium fluctuations. , 2008, Journal of neurophysiology.

[30]  Hema A. Murthy,et al.  Spike Estimation From Fluorescence Signals Using High-Resolution Property of Group Delay , 2019, IEEE Transactions on Signal Processing.

[31]  David S. Greenberg,et al.  Population imaging of ongoing neuronal activity in the visual cortex of awake rats , 2008, Nature Neuroscience.

[32]  Jeremy Freeman Open source tools for large-scale neuroscience , 2015, Current Opinion in Neurobiology.

[33]  Simon R. Schultz,et al.  CosMIC: A Consistent Metric for Spike Inference from Calcium Imaging , 2017, bioRxiv.

[34]  Xavier Serra,et al.  A Wavenet for Speech Denoising , 2017, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[35]  Matthias Bethge,et al.  Benchmarking Spike Rate Inference in Population Calcium Imaging , 2016, Neuron.

[36]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[37]  David Pfau,et al.  Simultaneous Denoising, Deconvolution, and Demixing of Calcium Imaging Data , 2016, Neuron.

[38]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[39]  Benjamin F. Grewe,et al.  High-speed in vivo calcium imaging reveals neuronal network activity with near-millisecond precision , 2010, Nature Methods.

[40]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[41]  Marius Pachitariu,et al.  Robustness of spike deconvolution for calcium imaging of neural spiking , 2017 .

[42]  Matthias Bethge,et al.  Saliency Benchmarking: Separating Models, Maps and Metrics , 2017, ArXiv.