Tracking-assisted Detection of Dendritic Spines in Time-Lapse Microscopic Images

Detecting morphological changes of dendritic spines in time-lapse microscopy images and correlating them with functional properties such as memory and learning, are fundamental and challenging problems in neurobiology research. In this paper, we propose an algorithm for dendritic spine detection in time series. The proposed approach initially performs spine detection at each time point and improves the accuracy by exploiting the information obtained from tracking of individual spines over time. To detect dendritic spines in a time point image we employ an SVM classifier trained by pre-labeled SIFT feature descriptors in combination with a dot enhancement filter. Second, to track the growth or loss of spines, we apply a SIFT-based rigid registration method for the alignment of time-series images. This step takes into account both the structure and the movement of objects, combined with a robust dynamic scheme to link information about spines that disappear and reappear over time. Next, we improve spine detection by employing a probabilistic dynamic programming approach to search for an optimum solution to accurately detect missed spines. Finally, we determine the spine location more precisely by performing a watershed-geodesic active contour model. We quantitatively assess the performance of the proposed spine detection algorithm based on annotations performed by biologists and compare its performance with the results obtained by the noncommercial software NeuronIQ. Experiments show that our approach can accurately detect and quantify spines in 2-photon microscopy time-lapse data and is able to accurately identify spine elimination and formation.

[1]  Stephen T. C. Wong,et al.  Automatic dendritic spine analysis in two‐photon laser scanning microscopy images , 2007, Cytometry Part A.

[2]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[3]  W. Brent Lindquist,et al.  An Image Analysis Algorithm for Dendritic Spines , 2002, Neural Computation.

[4]  Inbal Israely,et al.  Long Lasting Protein Synthesis- and Activity-Dependent Spine Shrinkage and Elimination after Synaptic Depression , 2013, PloS one.

[5]  Qiang Li,et al.  Selective enhancement filters for nodules, vessels, and airway walls in two- and three-dimensional CT scans. , 2003, Medical physics.

[6]  K. Svoboda,et al.  Rapid dendritic morphogenesis in CA1 hippocampal dendrites induced by synaptic activity. , 1999, Science.

[7]  S. Cobb,et al.  Synaptic plasticity deficits in an experimental model of rett syndrome: long-term potentiation saturation and its pharmacological reversal , 2011, Neuroscience.

[8]  Yong Zhang,et al.  Dendritic spine detection using curvilinear structure detector and LDA classifier , 2007, NeuroImage.

[9]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Xiaobo Zhou,et al.  A novel computational approach for automatic dendrite spines detection in two-photon laser scan microscopy , 2007, Journal of Neuroscience Methods.

[11]  Douglas B. Ehlenberger,et al.  Automated Three-Dimensional Detection and Shape Classification of Dendritic Spines from Fluorescence Microscopy Images , 2008, PloS one.

[12]  D. Muller,et al.  A simple method for organotypic cultures of nervous tissue , 1991, Journal of Neuroscience Methods.

[13]  Haruo Kasai,et al.  Protein Synthesis and Neurotrophin-Dependent Structural Plasticity of Single Dendritic Spines , 2008, Science.

[14]  M. Fischer,et al.  Rapid Actin-Based Plasticity in Dendritic Spines , 1998, Neuron.

[15]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[16]  Kok-Lim Low Linear Least-Squares Optimization for Point-to-Plane ICP Surface Registration , 2004 .

[17]  Devrim Ünay,et al.  An Evaluation on the Robustness of Five Popular Keypoint Descriptors to Image Modifications Specific to Laser Scanning Microscopy , 2018, IEEE Access.

[18]  Xiaobo Zhou,et al.  Mutual information-based feature selection in studying perturbation of dendritic structure caused by TSC2 inactivation , 2006, Neuroinformatics.

[19]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[20]  W. Brent Lindquist,et al.  Automated Algorithms for Multiscale Morphometry of Neuronal Dendrites , 2004, Neural Computation.

[21]  Karel Svoboda,et al.  Locally dynamic synaptic learning rules in pyramidal neuron dendrites , 2007, Nature.

[22]  J Son,et al.  Morphological change tracking of dendritic spines based on structural features , 2011, Journal of microscopy.

[23]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[24]  J. Pawley,et al.  Handbook of Biological Confocal Microscopy , 1990, Springer US.

[25]  Susumu Tonegawa,et al.  The Dendritic Branch Is the Preferred Integrative Unit for Protein Synthesis-Dependent LTP , 2011, Neuron.

[26]  Yong Zhang,et al.  A Global Spatial Similarity Optimization Scheme to Track Large Numbers of Dendritic Spines in Time-Lapse Confocal Microscopy , 2011, IEEE Transactions on Medical Imaging.

[27]  M. Sheng,et al.  Dentritic spines : structure, dynamics and regulation , 2001, Nature Reviews Neuroscience.

[28]  Claudia Clopath,et al.  Detection of axonal synapses in 3D two-photon images , 2017, PloS one.

[29]  A. Matus,et al.  Actin-based plasticity in dendritic spines. , 2000, Science.

[30]  Yong Zhang,et al.  A novel tracing algorithm for high throughput imaging Screening of neuron-based assays , 2007, Journal of Neuroscience Methods.

[31]  Stephen T. C. Wong,et al.  Integration of multiscale dendritic spine structure and function data into systems biology models , 2014, Front. Neuroanat..

[32]  Christian Gout,et al.  Geodesic active contour under geometrical conditions: theory and 3D applications , 2008, Numerical Algorithms.

[33]  Yong Zhang,et al.  An Automated Pipeline for Dendrite Spine Detection and Tracking of 3D Optical Microscopy Neuron Images of In Vivo Mouse Models , 2009, Neuroinformatics.

[34]  Mark F Bear,et al.  The mGluR theory of fragile X mental retardation , 2004, Trends in Neurosciences.