Multiscale Centerline Detection

Finding the centerline and estimating the radius of linear structures is a critical first step in many applications, ranging from road delineation in 2D aerial images to modeling blood vessels, lung bronchi, and dendritic arbors in 3D biomedical image stacks. Existing techniques rely either on filters designed to respond to ideal cylindrical structures or on classification techniques. The former tend to become unreliable when the linear structures are very irregular while the latter often has difficulties distinguishing centerline locations from neighboring ones, thus losing accuracy. We solve this problem by reformulating centerline detection in terms of a regression problem. We first train regressors to return the distances to the closest centerline in scale-space, and we apply them to the input images or volumes. The centerlines and the corresponding scale then correspond to the regressors local maxima, which can be easily identified. We show that our method outperforms state-of-the-art techniques for various 2D and 3D datasets. Moreover, our approach is very generic and also performs well on contour detection. We show an improvement above recent contour detection algorithms on the BSDS500 dataset.

[1]  J. Friedman Stochastic gradient boosting , 2002 .

[2]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[3]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[4]  Guido Gerig,et al.  Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images , 1998, Medical Image Anal..

[5]  Max W. K. Law,et al.  An Oriented Flux Symmetry Based Active Contour Model for Three Dimensional Vessel Segmentation , 2010, ECCV.

[6]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[7]  Laurent D. Cohen,et al.  Tubular Structure Segmentation Based on Minimal Path Method and Anisotropic Enhancement , 2011, International Journal of Computer Vision.

[8]  Dorin Comaniciu,et al.  Machine learning based vesselness measurement for coronary artery segmentation in cardiac CT volumes , 2011, Medical Imaging.

[9]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[10]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Vincent Lepetit,et al.  Accurate and Efficient Linear Structure Segmentation by Leveraging Ad Hoc Features with Learned Filters , 2012, MICCAI.

[12]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  C. Lawrence Zitnick,et al.  Structured Forests for Fast Edge Detection , 2013, 2013 IEEE International Conference on Computer Vision.

[14]  Yoshinobu Sato,et al.  A Hessian-based filter for vascular segmentation of noisy hepatic CT scans , 2012, International Journal of Computer Assisted Radiology and Surgery.

[15]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[16]  Yaonan Wang,et al.  Multiscale Bi-Gaussian Filter for Adjacent Curvilinear Structures Detection With Application to Vasculature Images , 2013, IEEE Transactions on Image Processing.

[17]  Jan Dirk Wegner,et al.  A Higher-Order CRF Model for Road Network Extraction , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Zhuowen Tu,et al.  Supervised Learning of Edges and Object Boundaries , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[19]  Badrinath Roysam,et al.  3-D Image Pre-processing Algorithms for Improved Automated Tracing of Neuronal Arbors , 2011, Neuroinformatics.

[20]  Ghassan Hamarneh,et al.  Hair Enhancement in Dermoscopic Images Using Dual-Channel Quaternion Tubularness Filters and MRF-Based Multilabel Optimization , 2014, IEEE Transactions on Image Processing.

[21]  Pascal Fua,et al.  Reconstructing Loopy Curvilinear Structures Using Integer Programming , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Pascal Fua,et al.  Steerable Features for Statistical 3D Dendrite Detection , 2009, MICCAI.

[23]  Mathews Jacob,et al.  Design of steerable filters for feature detection using canny-like criteria , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Zhuowen Tu,et al.  Auto-Context and Its Application to High-Level Vision Tasks and 3D Brain Image Segmentation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Shaohua Kevin Zhou,et al.  Hierarchical Discriminative Framework for Detecting Tubular Structures in 3D Images , 2013, IPMI.

[26]  Daphne Koller,et al.  Learning Spatial Context: Using Stuff to Find Things , 2008, ECCV.

[27]  Pietro Perona,et al.  Hierarchical Scene Annotation , 2013, BMVC.

[28]  Tolga Tasdizen,et al.  Image Segmentation with Cascaded Hierarchical Models and Logistic Disjunctive Normal Networks , 2013, 2013 IEEE International Conference on Computer Vision.

[29]  Martin Styner,et al.  Standardized evaluation methodology and reference database for evaluating coronary artery centerline extraction algorithms , 2009, Medical Image Anal..

[30]  Guillermo Sapiro,et al.  Discriminative learned dictionaries for local image analysis , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Rachid Deriche,et al.  Using Canny's criteria to derive a recursively implemented optimal edge detector , 1987, International Journal of Computer Vision.

[32]  Vincent Lepetit,et al.  Learning Separable Filters , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Hanspeter Pfister,et al.  Detection of Neuron Membranes in Electron Microscopy Images Using Multi-scale Context and Radon-Like Features , 2011, MICCAI.

[34]  Chao Lu,et al.  A learning based deformable template matching method for automatic rib centerline extraction and labeling in CT images , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Joseph J. Lim,et al.  Sketch Tokens: A Learned Mid-level Representation for Contour and Object Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Jonathan T. Barron,et al.  Multiscale Combinatorial Grouping , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Ross T. Whitaker,et al.  Detection of neuron membranes in electron microscopy images using a serial neural network architecture , 2010, Medical Image Anal..

[38]  Antonio Torralba,et al.  Sharing features: efficient boosting procedures for multiclass object detection , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[39]  Xiaofeng Ren,et al.  Discriminatively Trained Sparse Code Gradients for Contour Detection , 2012, NIPS.

[40]  Nicholas Ayache,et al.  Model-Based Detection of Tubular Structures in 3D Images , 2000, Comput. Vis. Image Underst..

[41]  Hongkai Xiong,et al.  3D tubular structure extraction using kernel-based superellipsoid model with Gaussian process regression , 2012, 2012 Visual Communications and Image Processing.

[42]  Gabriel Peyré,et al.  Extraction of tubular structures over an orientation domain , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Max W. K. Law,et al.  Three Dimensional Curvilinear Structure Detection Using Optimally Oriented Flux , 2008, ECCV.

[44]  Gady Agam,et al.  Probabilistic modeling based vessel enhancement in thoracic CT scans , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[45]  Tony Lindeberg,et al.  Scale-Space for Discrete Signals , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  I. Kakadiaris,et al.  Towards Segmentation of Irregular Tubular Structures in 3 D Confocal Microscope Images , 2006 .

[47]  Xin Huang,et al.  Road centreline extraction from high‐resolution imagery based on multiscale structural features and support vector machines , 2009 .

[48]  Geoffrey E. Hinton,et al.  Learning to Label Aerial Images from Noisy Data , 2012, ICML.

[49]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Yuanzhong Li,et al.  A machine learning approach to extract spinal column centerline from three-dimensional CT data , 2009, Medical Imaging.

[51]  E Meijering,et al.  Design and validation of a tool for neurite tracing and analysis in fluorescence microscopy images , 2004, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[52]  Pascal Fua,et al.  Detecting Irregular Curvilinear Structures in Gray Scale and Color Imagery Using Multi-directional Oriented Flux , 2013, 2013 IEEE International Conference on Computer Vision.

[53]  Vincent Lepetit,et al.  Supervised Feature Learning for Curvilinear Structure Segmentation , 2013, MICCAI.

[54]  Pietro Perona,et al.  Mutual Boosting for Contextual Inference , 2003, NIPS.

[55]  Guido Gerig,et al.  3D Multi-scale line filter for segmentation and visualization of curvilinear structures in medical images , 1997, CVRMed.

[56]  Vincent Lepetit,et al.  Multiscale Centerline Detection by Learning a Scale-Space Distance Transform , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[57]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[58]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  Charles V. Stewart,et al.  Retinal Vessel Centerline Extraction Using Multiscale Matched Filters, Confidence and Edge Measures , 2006, IEEE Transactions on Medical Imaging.

[60]  Pascal Fua,et al.  Semi-Automated Reconstruction of Curvilinear Structures in Noisy 2D images and 3D image stacks , 2013 .