Detection of axonal synapses in 3D two-photon images

Studies of structural plasticity in the brain often require the detection and analysis of axonal synapses (boutons). To date, bouton detection has been largely manual or semi-automated, relying on a step that traces the axons before detection the boutons. If tracing the axon fails, the accuracy of bouton detection is compromised. In this paper, we propose a new algorithm that does not require tracing the axon to detect axonal boutons in 3D two-photon images taken from the mouse cortex. To find the most appropriate techniques for this task, we compared several well-known algorithms for interest point detection and feature descriptor generation. The final algorithm proposed has the following main steps: (1) a Laplacian of Gaussian (LoG) based feature enhancement module to accentuate the appearance of boutons; (2) a Speeded Up Robust Features (SURF) interest point detector to find candidate locations for feature extraction; (3) non-maximum suppression to eliminate candidates that were detected more than once in the same local region; (4) generation of feature descriptors based on Gabor filters; (5) a Support Vector Machine (SVM) classifier, trained on features from labelled data, and was used to distinguish between bouton and non-bouton candidates. We found that our method achieved a Recall of 95%, Precision of 76%, and F1 score of 84% within a new dataset that we make available for accessing bouton detection. On average, Recall and F1 score were significantly better than the current state-of-the-art method, while Precision was not significantly different. In conclusion, in this article we demonstrate that our approach, which is independent of axon tracing, can detect boutons to a high level of accuracy, and improves on the detection performance of existing approaches. The data and code (with an easy to use GUI) used in this article are available from open source repositories.

[1]  Kullervo Hynynen,et al.  Deep Learning Convolutional Networks for Multiphoton Microscopy Vasculature Segmentation , 2016, ArXiv.

[2]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  B. S. Manjunath,et al.  Statistical analysis of dendritic spine distributions in rat hippocampal cultures , 2013, BMC Bioinformatics.

[4]  Chris H. Q. Ding,et al.  Minimum redundancy feature selection from microarray gene expression data , 2003, Computational Systems Bioinformatics. CSB2003. Proceedings of the 2003 IEEE Bioinformatics Conference. CSB2003.

[5]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[6]  Douglas B. Ehlenberger,et al.  Automated Three-Dimensional Detection and Shape Classification of Dendritic Spines from Fluorescence Microscopy Images , 2008, PloS one.

[7]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Sean L. Hill,et al.  BigNeuron: Large-Scale 3D Neuron Reconstruction from Optical Microscopy Images , 2015, Neuron.

[9]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[10]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[11]  Dimiter Prodanov,et al.  Automatic morphometry of synaptic boutons of cultured cells using granulometric analysis of digital images , 2006, Journal of Neuroscience Methods.

[12]  K. Svoboda,et al.  Cell Type-Specific Structural Plasticity of Axonal Branches and Boutons in the Adult Neocortex , 2006, Neuron.

[13]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  C. Gilbert,et al.  Axonal Dynamics of Excitatory and Inhibitory Neurons in Somatosensory Cortex , 2010, PLoS biology.

[15]  W. Brent Lindquist,et al.  An Image Analysis Algorithm for Dendritic Spines , 2002, Neural Computation.

[16]  Jun Noguchi,et al.  Structural dynamics of dendritic spines in memory and cognition , 2010, Trends in Neurosciences.

[17]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[18]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[19]  William E. Higgins,et al.  Efficient Gabor filter design for texture segmentation , 1996, Pattern Recognit..

[20]  Hanchuan Peng,et al.  A distance-field based automatic neuron tracing method , 2013, BMC Bioinformatics.

[21]  Ju Lu,et al.  REPETITIVE MOTOR LEARNING INDUCES COORDINATED FORMATION OF CLUSTERED DENDRITIC SPINES IN VIVO , 2012, Nature.

[22]  Tianming Liu,et al.  SmartTracing: self-learning-based Neuron reconstruction , 2015, Brain Informatics.

[23]  N. Ranganathan,et al.  Gabor filter-based edge detection , 1992, Pattern Recognit..

[24]  Carlos Portera-Cailliau,et al.  Altered Synaptic Dynamics during Normal Brain Aging , 2013, The Journal of Neuroscience.

[25]  Hanchuan Peng,et al.  APP2: automatic tracing of 3D neuron morphology based on hierarchical pruning of a gray-weighted image distance-tree , 2013, Bioinform..

[26]  V. De Paola,et al.  Synaptic Elimination and Protection after Minimal Injury Depend on Cell Type and Their Prelesion Structural Dynamics in the Adult Cerebral Cortex , 2013, The Journal of Neuroscience.

[27]  Dominique Muller,et al.  LTP Promotes a Selective Long-Term Stabilization and Clustering of Dendritic Spines , 2008, PLoS biology.

[28]  Stephen T. C. Wong,et al.  Robust 3D reconstruction and identification of dendritic spines from optical microscopy imaging , 2009, Medical Image Anal..

[29]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[30]  Cordelia Schmid,et al.  Indexing Based on Scale Invariant Interest Points , 2001, ICCV.

[31]  Vincenzo De Paola,et al.  EPBscore: a Novel Method for Computer-Assisted Analysis of Axonal Structure and Dynamics , 2015, Neuroinformatics.

[32]  Ross T. Whitaker,et al.  Detection of neuron membranes in electron microscopy images using a serial neural network architecture , 2010, Medical Image Anal..

[33]  Eugene W. Myers,et al.  Automatic 3D neuron tracing using all-path pruning , 2011, Bioinform..

[34]  Huiyu Zhou,et al.  Object tracking using SIFT features and mean shift , 2009, Comput. Vis. Image Underst..

[35]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[36]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[37]  Tobias Bonhoeffer,et al.  LTD Induction Causes Morphological Changes of Presynaptic Boutons and Reduces Their Contacts with Spines , 2008, Neuron.

[38]  Zhi Zhou,et al.  TReMAP: Automatic 3D Neuron Reconstruction Based on Tracing, Reverse Mapping and Assembling of 2D Projections , 2015, Neuroinformatics.

[39]  Sen Song,et al.  Increased axonal bouton dynamics in the aging mouse cortex , 2013, Proceedings of the National Academy of Sciences.

[40]  T. Kitti,et al.  An Object Recognition and Identification System Using the Harris Corner Detection Method , 2012 .

[41]  Hui Kong,et al.  A Generalized Laplacian of Gaussian Filter for Blob Detection and Its Applications , 2013, IEEE Transactions on Cybernetics.

[42]  J. R. Newton,et al.  Remodeling of Synaptic Structure in Sensory Cortical Areas In Vivo , 2006, The Journal of Neuroscience.

[43]  Steve M. Potter,et al.  MDL Constrained 3-D Grayscale Skeletonization Algorithm for Automated Extraction of Dendrites and Spines from Fluorescence Confocal Images , 2009, Neuroinformatics.