NeuroSeg: automated cell detection and segmentation for in vivo two-photon Ca2+ imaging data

Two-photon Ca2+ imaging has become a popular approach for monitoring neuronal population activity with cellular or subcellular resolution in vivo. This approach allows for the recording of hundreds to thousands of neurons per animal and thus leads to a large amount of data to be processed. In particular, manually drawing regions of interest is the most time-consuming aspect of data analysis. However, the development of automated image analysis pipelines, which will be essential for dealing with the likely future deluge of imaging data, remains a major challenge. To address this issue, we developed NeuroSeg, an open-source MATLAB program that can facilitate the accurate and efficient segmentation of neurons in two-photon Ca2+ imaging data. We proposed an approach using a generalized Laplacian of Gaussian filter to detect cells and weighting-based segmentation to separate individual cells from the background. We tested this approach on an in vivo two-photon Ca2+ imaging dataset obtained from mouse cortical neurons with differently sized view fields. We show that this approach exhibits superior performance for cell detection and segmentation compared with the existing published tools. In addition, we integrated the previously reported, activity-based segmentation into our approach and found that this combined method was even more promising. The NeuroSeg software, including source code and graphical user interface, is freely available and will be a useful tool for in vivo brain activity mapping.

[1]  Bo Zhang,et al.  Neuron Segmentation Based on CNN with Semi-Supervised Regularization , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[2]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[3]  Simon X. Chen,et al.  Emergence of reproducible spatiotemporal activity during motor learning , 2014, Nature.

[4]  Lin Yang,et al.  An Automatic Learning-Based Framework for Robust Nucleus Segmentation , 2016, IEEE Transactions on Medical Imaging.

[5]  D. Kleinfeld,et al.  Anatomical and functional imaging of neurons using 2-photon laser scanning microscopy , 1994, Journal of Neuroscience Methods.

[6]  Fred A. Hamprecht,et al.  Learning Multi-level Sparse Representations , 2013, NIPS.

[7]  Erik H. W. Meijering,et al.  Cell Segmentation: 50 Years Down the Road [Life Sciences] , 2012, IEEE Signal Processing Magazine.

[8]  Nathalie L Rochefort,et al.  Reactivation of the same synapses during spontaneous up states and sensory stimuli. , 2013, Cell reports.

[9]  Tsai-Wen Chen,et al.  Comprehensive imaging of cortical networks , 2015, Current Opinion in Neurobiology.

[10]  Stefan R. Pulver,et al.  Ultra-sensitive fluorescent proteins for imaging neuronal activity , 2013, Nature.

[11]  W. Denk,et al.  Deep tissue two-photon microscopy , 2005, Nature Methods.

[12]  C. Stosiek,et al.  In vivo two-photon calcium imaging of neuronal networks , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[13]  Ondrej Novak,et al.  Two-Photon Processor and SeNeCA: a freely available software package to process data from two-photon calcium imaging at speeds down to several milliseconds per frame. , 2013, Journal of neurophysiology.

[14]  Huimin Ma,et al.  Ultrasensitive Fluorescent Probes Reveal an Adverse Action of Dipeptide Peptidase IV and Fibroblast Activation Protein during Proliferation of Cancer Cells. , 2016, Analytical chemistry.

[15]  Bert Sakmann,et al.  Linear integration of spine Ca2+ signals in layer 4 cortical neurons in vivo , 2014, Proceedings of the National Academy of Sciences.

[16]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[17]  Yousef Al-Kofahi,et al.  Improved Automatic Detection and Segmentation of Cell Nuclei in Histopathology Images , 2010, IEEE Transactions on Biomedical Engineering.

[18]  Zengcai V. Guo,et al.  Flow of Cortical Activity Underlying a Tactile Decision in Mice , 2014, Neuron.

[19]  K. Svoboda,et al.  Principles of Two-Photon Excitation Microscopy and Its Applications to Neuroscience , 2006, Neuron.

[20]  Y. Freund,et al.  Automatic identification of fluorescently labeled brain cells for rapid functional imaging. , 2010, Journal of neurophysiology.

[21]  R. Romo,et al.  Conversion of sensory signals into perceptual decisions , 2013, Progress in Neurobiology.

[22]  H. Sebastian Seung,et al.  Automatic Neuron Detection in Calcium Imaging Data Using Convolutional Networks , 2016, NIPS.

[23]  Jens C. Otte,et al.  Fast Segmentation of Stained Nuclei in Terabyte-Scale, Time Resolved 3D Microscopy Image Stacks , 2014, PloS one.

[24]  E. Meijering.  Cell Segmentation : 50 Years Down the Road , 2012 .

[25]  J. Simon Wiegert,et al.  Multiple dynamic representations in the motor cortex during sensorimotor learning , 2012, Nature.

[26]  David F. Meaney,et al.  Automated quantification of neuronal networks and single-cell calcium dynamics using calcium imaging , 2015, Journal of Neuroscience Methods.

[27]  K. Svoboda,et al.  A Cellular Resolution Map of Barrel Cortex Activity during Tactile Behavior , 2015, Neuron.

[28]  David Pfau,et al.  Simultaneous Denoising, Deconvolution, and Demixing of Calcium Imaging Data , 2016, Neuron.

[29]  Dylan R. Muir,et al.  FocusStack and StimServer: a new open source MATLAB toolchain for visual stimulation and analysis of two-photon calcium neuronal imaging data , 2015, Front. Neuroinform..

[30]  Nathalie L Rochefort,et al.  Functional mapping of single spines in cortical neurons in vivo , 2011, Nature.

[31]  Attila Losonczy,et al.  SIMA: Python software for analysis of dynamic fluorescence imaging data , 2014, Front. Neuroinform..

[32]  Mrinal K. Mandal,et al.  Automatic Nuclei Detection Based on Generalized Laplacian of Gaussian Filters , 2017, IEEE Journal of Biomedical and Health Informatics.

[33]  K. Svoboda,et al.  A large field of view two-photon mesoscope with subcellular resolution for in vivo imaging , 2016, bioRxiv.

[34]  S. Bano,et al.  Anatomical and functional imaging in endocrine hypertension , 2012, Indian journal of endocrinology and metabolism.

[35]  Toru Aonishi,et al.  Detecting cells using non-negative matrix factorization on calcium imaging data , 2014, Neural Networks.

[36]  Mark J. Schnitzer,et al.  Automated Analysis of Cellular Signals from Large-Scale Calcium Imaging Data , 2009, Neuron.

[37]  Takashi Kawashima,et al.  Mapping brain activity at scale with cluster computing , 2014, Nature Methods.

[38]  F. Helmchen,et al.  Reorganization of cortical population activity imaged throughout long-term sensory deprivation , 2012, Nature Neuroscience.

[39]  Woei-Chyn Chu,et al.  Performance measure characterization for evaluating neuroimage segmentation algorithms , 2009, NeuroImage.

[40]  Jagath C. Rajapakse,et al.  Segmentation of Clustered Nuclei With Shape Markers and Marking Function , 2009, IEEE Transactions on Biomedical Engineering.

[41]  Hui Kong,et al.  A Generalized Laplacian of Gaussian Filter for Blob Detection and Its Applications , 2013, IEEE Transactions on Cybernetics.

[42]  L. Paninski,et al.  Simultaneous Multi-plane Imaging of Neural Circuits , 2016, Neuron.