Reinforcing neuron extraction and spike inference in calcium imaging using deep self-supervised denoising

Calcium imaging has transformed neuroscience research by providing a methodology for monitoring the activity of neural circuits with single-cell resolution. However, calcium imaging is inherently susceptible to detection noise, especially when imaging with high frame rate or under low excitation dosage. Here we developed DeepCAD, a self-supervised deep-learning method for spatiotemporal enhancement of calcium imaging data that does not require any high signal-to-noise ratio (SNR) observations. DeepCAD suppresses detection noise and improves the SNR more than tenfold, which reinforces the accuracy of neuron extraction and spike inference and facilitates the functional analysis of neural circuits.

[1]  Ivano Ruo-Berchera,et al.  Realization of the first sub-shot-noise wide field microscope , 2016, Light: Science & Applications.

[2]  Christophe Zimmer,et al.  Deep learning massively accelerates super-resolution localization microscopy , 2018, Nature Biotechnology.

[3]  Johannes D. Seelig,et al.  Video-rate volumetric functional imaging of the brain at synaptic resolution , 2016, Nature Neuroscience.

[4]  Christine Grienberger,et al.  Imaging Calcium in Neurons , 2012, Neuron.

[5]  Jaakko Lehtinen,et al.  Noise2Noise: Learning Image Restoration without Clean Data , 2018, ICML.

[6]  Anne E Carpenter,et al.  Nucleus segmentation across imaging experiments: the 2018 Data Science Bowl , 2019, Nature Methods.

[7]  Loïc Royer,et al.  Noise2Self: Blind Denoising by Self-Supervision , 2019, ICML.

[8]  Dimitre G. Ouzounov,et al.  Deep three-photon imaging of the brain in intact adult zebrafish , 2020, Nature Methods.

[9]  Karen O. Egiazarian,et al.  Nonlocal Transform-Domain Filter for Volumetric Data Denoising and Reconstruction , 2013, IEEE Transactions on Image Processing.

[10]  Florian Jug,et al.  Noise2Void - Learning Denoising From Single Noisy Images , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Loic A. Royer,et al.  Content-aware image restoration: pushing the limits of fluorescence microscopy , 2018, Nature Methods.

[12]  David Pfau,et al.  Simultaneous Denoising, Deconvolution, and Demixing of Calcium Imaging Data , 2016, Neuron.

[13]  Amiram Grinvald,et al.  Accurate spike estimation from noisy calcium signals for ultrafast three-dimensional imaging of large neuronal populations in vivo , 2016, Nature Communications.

[14]  Pengcheng Zhou,et al.  CaImAn an open source tool for scalable calcium imaging data analysis , 2019, eLife.

[15]  K. Svoboda,et al.  The Life Cycle of Ca2+ Ions in Dendritic Spines , 2002, Neuron.

[16]  Stefan R. Pulver,et al.  Ultra-sensitive fluorescent proteins for imaging neuronal activity , 2013, Nature.

[17]  Jeremy Freeman,et al.  Technologies for imaging neural activity in large volumes , 2016, Nature Neuroscience.

[18]  Aravinthan D. T. Samuel,et al.  Imaging whole nervous systems: insights into behavior from worms to fish , 2018, Nature Methods.

[19]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  Kaspar Podgorski,et al.  Brain heating induced by near infrared lasers during multi-photon microscopy , 2016, bioRxiv.

[22]  Fraser T. Sparks,et al.  Volumetric Ca2+ Imaging in the Mouse Brain Using Hybrid Multiplexed Sculpted Light Microscopy , 2019, Cell.

[23]  J. J. Macklin,et al.  High-performance calcium sensors for imaging activity in neuronal populations and microcompartments , 2019, Nature Methods.

[24]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[25]  A. Ozcan,et al.  Deep learning enables cross-modality super-resolution in fluorescence microscopy , 2018, Nature Methods.

[26]  Stavroula Skylaki,et al.  Challenges in long-term imaging and quantification of single-cell dynamics , 2016, Nature Biotechnology.

[27]  Loic A. Royer,et al.  Applications, promises, and pitfalls of deep learning for fluorescence image reconstruction , 2018, Nature Methods.

[28]  Kenneth D. Harris,et al.  Community-based benchmarking improves spike rate inference from two-photon calcium imaging data , 2018, PLoS Comput. Biol..

[29]  K. Svoboda,et al.  Principles of Two-Photon Excitation Microscopy and Its Applications to Neuroscience , 2006, Neuron.

[30]  Kaiming He,et al.  Group Normalization , 2018, ECCV.

[31]  Xusan Yang,et al.  Quantitative analysis of 1300-nm three-photon calcium imaging in the mouse brain , 2020, eLife.

[32]  E. Pnevmatikakis,et al.  NoRMCorre: An online algorithm for piecewise rigid motion correction of calcium imaging data , 2017, Journal of Neuroscience Methods.