Convolutional Neural Network Cascade Based Neuron Termination Detection in 3D Image Stacks

Full reconstruction of neuron morphology in volumetric images is of fundamental interest for the analysis and understanding of neuron function. Termination points could be very good candidates of seeding points for neuron reconstructing (tracing) applications. Previously, some hand-crafted models were proposed to detect the neuron terminations. However, they are highly depending on empirical setting of the parameters for different images. In this paper, we propose a neuron termination detection approach with two-level designed convolutional networks. At first level, a Triple-Crossing 2.5D convolutional neural network with inception block and residual block is used to generate the termination candidate points by early identification of ‘many’ volumetric patches. At second level, those termination candidates are further evaluated by using the cubic patches across the adjacent slices of those candidates. It is shown that the convolutional neural network cascade based detection approach outperforms the current top-performing neuron termination detection methods in many challenging datasets.

[1]  Badrinath Roysam,et al.  Improved detection of branching points in algorithms for automated neuron tracing from 3D confocal images , 2008, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[2]  Hanchuan Peng,et al.  Extensible visualization and analysis for multidimensional images using Vaa3D , 2014, Nature Protocols.

[3]  Benjamin Bustos,et al.  Harris 3D: a robust extension of the Harris operator for interest point detection on 3D meshes , 2011, The Visual Computer.

[4]  Zhi Zhou,et al.  TReMAP: Automatic 3D Neuron Reconstruction Based on Tracing, Reverse Mapping and Assembling of 2D Projections , 2015, Neuroinformatics.

[5]  Mubarak Shah,et al.  A 3-dimensional sift descriptor and its application to action recognition , 2007, ACM Multimedia.

[6]  Min Liu,et al.  Robust plant cell tracking using local spatio-temporal context , 2016, Neurocomputing.

[7]  Yann LeCun,et al.  Regularization of Neural Networks using DropConnect , 2013, ICML.

[8]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Hanchuan Peng,et al.  From DIADEM to BigNeuron , 2015, Neuroinformatics.

[10]  Erik H. W. Meijering,et al.  Automated neuron morphology reconstruction using fuzzy-logic detection and Bayesian tracing algorithms , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[11]  Iasonas Kokkinos,et al.  Scale-invariant heat kernel signatures for non-rigid shape recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Ju Lu,et al.  The DIADEM Data Sets: Representative Light Microscopy Images of Neuronal Morphology to Advance Automation of Digital Reconstructions , 2011, Neuroinformatics.

[14]  Min Liu,et al.  Robust Plant Cell Tracking in Noisy Image Sequences Using Optimal CRF Graph Matching , 2017, IEEE Signal Processing Letters.

[15]  Ronald M. Summers,et al.  Improving Computer-Aided Detection Using Convolutional Neural Networks and Random View Aggregation , 2015, IEEE Transactions on Medical Imaging.

[16]  Sergio Guadarrama,et al.  Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[18]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[19]  Erik Meijering,et al.  Neuron tracing in perspective , 2010, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[20]  Amit K. Roy-Chowdhury,et al.  3D Neuron Tip Detection in Volumetric Microscopy Images , 2011, 2011 IEEE International Conference on Bioinformatics and Biomedicine.