Quantifying uncertainty in spikes estimated from calcium imaging data.

In recent years, a number of methods have been proposed to estimate the times at which a neuron spikes on the basis of calcium imaging data. However, quantifying the uncertainty associated with these estimated spikes remains an open problem. We consider a simple and well-studied model for calcium imaging data, which states that calcium decays exponentially in the absence of a spike, and instantaneously increases when a spike occurs. We wish to test the null hypothesis that the neuron did not spike-i.e., that there was no increase in calcium-at a particular timepoint at which a spike was estimated. In this setting, classical hypothesis tests lead to inflated Type I error, because the spike was estimated on the same data used for testing. To overcome this problem, we propose a selective inference approach. We describe an efficient algorithm to compute finite-sample $p$-values that control selective Type I error, and confidence intervals with correct selective coverage, for spikes estimated using a recent proposal from the literature. We apply our proposal in simulation and on calcium imaging data from the $\texttt{spikefinder}$ challenge.

[1]  Daniel Yekutieli,et al.  Adjusted Bayesian inference for selected parameters , 2008, 0801.0499.

[2]  Marius Pachitariu,et al.  Computational processing of neural recordings from calcium imaging data , 2019, Current Opinion in Neurobiology.

[3]  Stefan R. Pulver,et al.  Ultra-sensitive fluorescent proteins for imaging neuronal activity , 2013, Nature.

[4]  Yi-Ching Yao Estimating the number of change-points via Schwarz' criterion , 1988 .

[5]  Philipp J. Keller,et al.  Whole-brain functional imaging at cellular resolution using light-sheet microscopy , 2013, Nature Methods.

[6]  Runze Li,et al.  CONSISTENT SELECTION OF THE NUMBER OF CHANGE-POINTS VIA SAMPLE-SPLITTING. , 2020, Annals of statistics.

[7]  Daniela Witten,et al.  EXACT SPIKE TRAIN INFERENCE VIA ℓ0 OPTIMIZATION. , 2017, The annals of applied statistics.

[8]  Nilanjan Chatterjee,et al.  Post-Selection Inference Following Aggregate Level Hypothesis Testing in Large-Scale Genomic Data , 2018 .

[9]  Liam Paninski,et al.  Bayesian methods for event analysis of intracellular currents , 2016, Journal of Neuroscience Methods.

[10]  J. Victor,et al.  Nature and precision of temporal coding in visual cortex: a metric-space analysis. , 1996, Journal of neurophysiology.

[11]  Liam Paninski,et al.  Fast Active Set Methods for Online Spike Inference from Calcium Imaging , 2016, NIPS.

[12]  Rafael Yuste,et al.  Fast nonnegative deconvolution for spike train inference from population calcium imaging. , 2009, Journal of neurophysiology.

[13]  Dennis L. Sun,et al.  Exact post-selection inference, with application to the lasso , 2013, 1311.6238.

[14]  Z. Harchaoui,et al.  Multiple Change-Point Estimation With a Total Variation Penalty , 2010 .

[15]  Yi-Ching Yao,et al.  LEAST-SQUARES ESTIMATION OF A STEP FUNCTION , 2016 .

[16]  Jonathan D. Victor,et al.  Metric-space analysis of spike trains: theory, algorithms and application , 1998, q-bio/0309031.

[17]  Dennis L. Sun,et al.  Optimal Inference After Model Selection , 2014, 1410.2597.

[18]  Liam Paninski,et al.  Model-Based Decoding, Information Estimation, and Change-Point Detection Techniques for Multineuron Spike Trains , 2011, Neural Computation.

[19]  Xue-Xin Wei,et al.  A zero-inflated gamma model for post-deconvolved calcium imaging traces , 2019, bioRxiv.

[20]  K. Button,et al.  Double-dipping revisited , 2019, Nature Neuroscience.

[21]  Kenneth D. Harris,et al.  Community-based benchmarking improves spike rate inference from two-photon calcium imaging data , 2018, PLoS Comput. Biol..

[22]  Paul Fearnhead,et al.  On optimal multiple changepoint algorithms for large data , 2014, Statistics and Computing.

[23]  P. Fearnhead,et al.  Testing for a change in mean after changepoint detection , 2019, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[24]  Ning Hao,et al.  Multiple Change-point Detection: a Selective Overview , 2015, 1512.04093.

[25]  Sina Farsiu,et al.  Information-Theoretic Approach and Fundamental Limits of Resolving Two Closely Timed Neuronal Spikes in Mouse Brain Calcium Imaging , 2018, IEEE Transactions on Biomedical Engineering.

[26]  Ilana B. Witten,et al.  Inferring spikes from calcium imaging in dopamine neurons , 2020, bioRxiv.

[27]  Piotr Fryzlewicz,et al.  Wild binary segmentation for multiple change-point detection , 2014, 1411.0858.

[28]  Matthias Bethge,et al.  Benchmarking Spike Rate Inference in Population Calcium Imaging , 2016, Neuron.

[29]  Brendon O. Watson,et al.  Spike inference from calcium imaging using sequential Monte Carlo methods. , 2009, Biophysical journal.

[30]  M. Kosorok,et al.  ASYMPTOTICS FOR CHANGE-POINT MODELS UNDER VARYING DEGREES OF MIS-SPECIFICATION. , 2014, Annals of statistics.

[31]  Max G'Sell,et al.  Post‐selection inference for changepoint detection algorithms with application to copy number variation data , 2018, Biometrics.

[32]  H. Leeb,et al.  On the Length of Post-Model-Selection Confidence Intervals Conditional on Polyhedral Constraints , 2020 .

[33]  E. Boyden,et al.  Simultaneous whole-animal 3D-imaging of neuronal activity using light-field microscopy , 2014, Nature Methods.

[34]  David Pfau,et al.  Simultaneous Denoising, Deconvolution, and Demixing of Calcium Imaging Data , 2016, Neuron.

[35]  Valérie Ventura,et al.  Spike Train Decoding Without Spike Sorting , 2008, Neural Computation.

[36]  Amiram Grinvald,et al.  Accurate spike estimation from noisy calcium signals for ultrafast three-dimensional imaging of large neuronal populations in vivo , 2016, Nature Communications.

[37]  Ali Shojaie,et al.  In Defense of the Indefensible: A Very Naïve Approach to High-Dimensional Inference. , 2017, Statistical science : a review journal of the Institute of Mathematical Statistics.

[38]  Malay Ghosh,et al.  Objective Priors: An Introduction for Frequentists , 2011, 1108.2120.

[39]  Liam Paninski,et al.  Fast online deconvolution of calcium imaging data , 2016, PLoS Comput. Biol..

[40]  Kenneth D Harris,et al.  Robustness of Spike Deconvolution for Neuronal Calcium Imaging , 2018, The Journal of Neuroscience.

[41]  Paul Fearnhead,et al.  Fast nonconvex deconvolution of calcium imaging data. , 2018, Biostatistics.