Reconstructing Curvilinear Networks Using Path Classifiers and Integer Programming

We propose a novel approach to automated delineation of curvilinear structures that form complex and potentially loopy networks. By representing the image data as a graph of potential paths, we first show how to weight these paths using discriminatively-trained classifiers that are both robust and generic enough to be applied to very different imaging modalities. We then present an Integer Programming approach to finding the optimal subset of paths, subject to structural and topological constraints that eliminate implausible solutions. Unlike earlier approaches that assume a tree topology for the networks, ours explicitly models the fact that the networks may contain loops, and can reconstruct both cyclic and acyclic ones. We demonstrate the effectiveness of our approach on a variety of challenging datasets including aerial images of road networks and micrographs of neural arbors, and show that it outperforms state-of-the-art techniques.

[1]  Rangasami L. Kashyap,et al.  Building Skeleton Models via 3-D Medial Surface/Axis Thinning Algorithms , 1994, CVGIP Graph. Model. Image Process..

[2]  Amit Mukherjee,et al.  Automated reconstruction of neural trees using front re-initialization , 2012, Medical Imaging.

[3]  David Mayerich,et al.  NetMets: software for quantifying and visualizing errors in biological network segmentation , 2012, BMC Bioinformatics.

[4]  Erik Meijering,et al.  Neuron tracing in perspective , 2010, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[5]  Johannes E. Schindelin,et al.  TrakEM2 Software for Neural Circuit Reconstruction , 2012, PloS one.

[6]  Max W. K. Law,et al.  An Oriented Flux Symmetry Based Active Contour Model for Three Dimensional Vessel Segmentation , 2010, ECCV.

[7]  Pascal Fua,et al.  Semi-Automated Reconstruction of Curvilinear Structures in Noisy 2D images and 3D image stacks , 2013 .

[8]  Armen Stepanyants,et al.  Detection of the optimal neuron traces in confocal microscopy images , 2009, Journal of Neuroscience Methods.

[9]  Pascal Fua,et al.  Reconstructing Loopy Curvilinear Structures Using Integer Programming , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Changming Sun,et al.  HCA-Vision , 2010, Journal of biomolecular screening.

[11]  Ju Lu,et al.  Neuronal Tracing for Connectomic Studies , 2011, Neuroinformatics.

[12]  L. Gouveia,et al.  Models and heuristics for a minimum arborescence problem , 2008 .

[13]  Pascal Fua,et al.  Making Action Recognition Robust to Occlusions and Viewpoint Changes , 2010, ECCV.

[14]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[15]  E Meijering,et al.  Design and validation of a tool for neurite tracing and analysis in fluorescence microscopy images , 2004, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[16]  Chia-Ling Tsai,et al.  A Broadly Applicable 3-D Neuron Tracing Method Based on Open-Curve Snake , 2011, Neuroinformatics.

[17]  Vivek Mehta,et al.  Automated Tracing of Neurites from Light Microscopy Stacks of Images , 2011, Neuroinformatics.

[18]  Giorgio A. Ascoli,et al.  Automated reconstruction of neuronal morphology: An overview , 2011, Brain Research Reviews.

[19]  Hausser Michael,et al.  One rule to grow them all: A general theory of neuronal branching and its practical application , 2010 .

[20]  Bunyarit Uyyanonvara,et al.  Blood vessel segmentation methodologies in retinal images - A survey , 2012, Comput. Methods Programs Biomed..

[21]  Deniz Erdogmus,et al.  Principal Curves as Skeletons of Tubular Objects , 2011, Neuroinformatics.

[22]  Anthony J. Yezzi,et al.  Vessels as 4-D Curves: Global Minimal 4-D Paths to Extract 3-D Tubular Surfaces and Centerlines , 2007, IEEE Transactions on Medical Imaging.

[23]  Changming Sun,et al.  Linear Feature Detection on GPUs , 2010, 2010 International Conference on Digital Image Computing: Techniques and Applications.

[24]  Alex M. Andrew,et al.  Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid Mechanics, Computer Vision, and Materials Science (2nd edition) , 2000 .

[25]  M. Elena Martinez-Perez,et al.  A method for semiautomatic tracing and morphological measuring of neurite outgrowth from DIC sequences , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Eugene W. Myers,et al.  Automatic 3D neuron tracing using all-path pruning , 2011, Bioinform..

[27]  Giorgio A. Ascoli,et al.  A cross-platform freeware tool for digital reconstruction of neuronal arborizations from image stacks , 2007, Neuroinformatics.

[28]  Richard Szeliski,et al.  Multi-image matching using multi-scale oriented patches , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[29]  J C Fiala,et al.  Reconstruct: a free editor for serial section microscopy , 2005, Journal of microscopy.

[30]  Max W. K. Law,et al.  Three Dimensional Curvilinear Structure Detection Using Optimally Oriented Flux , 2008, ECCV.

[31]  J. Douglas Armstrong,et al.  Bioinformatics Applications Note Systems Biology Simple Neurite Tracer: Open Source Software for Reconstruction, Visualization and Analysis of Neuronal Processes , 2022 .

[32]  Eugene W. Myers,et al.  Proof-editing is the Bottleneck Of 3D Neuron Reconstruction: The Problem and Solutions , 2011, Neuroinformatics.

[33]  Khalid A. Al-Kofahi,et al.  Rapid automated three-dimensional tracing of neurons from confocal image stacks , 2002, IEEE Transactions on Information Technology in Biomedicine.

[34]  Hanchuan Peng,et al.  APP2: automatic tracing of 3D neuron morphology based on hierarchical pruning of a gray-weighted image distance-tree , 2013, Bioinform..

[35]  Douglas B. Ehlenberger,et al.  New techniques for imaging, digitization and analysis of three-dimensional neural morphology on multiple scales , 2005, Neuroscience.

[36]  Ioannis A. Kakadiaris,et al.  Automatic Reconstruction of Dendrite Morphology from Optical Section Stacks , 2006, CVAMIA.

[37]  Pascal Fua,et al.  Automated Reconstruction of Dendritic and Axonal Trees by Global Optimization with Geometric Priors , 2011, Neuroinformatics.

[38]  Shih-Fu Chang,et al.  Automatic Reconstruction of Neural Morphologies with Multi-Scale Tracking , 2012, Front. Neural Circuits.

[39]  R. W. Draft,et al.  Transgenic strategies for combinatorial expression of fluorescent proteins in the nervous system , 2007, Nature.

[40]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[41]  Eugene W. Myers,et al.  Automated Reconstruction of Neuronal Morphology Based on Local Geometrical and Global Structural Models , 2011, Neuroinformatics.

[42]  Hong Shen,et al.  Rapid automated tracing and feature extraction from retinal fundus images using direct exploratory algorithms , 1999, IEEE Transactions on Information Technology in Biomedicine.

[43]  Xiaobo Zhou,et al.  Reconstruction of the neuromuscular junction connectome , 2010, Bioinform..

[44]  Jan Dirk Wegner,et al.  A Higher-Order CRF Model for Road Network Extraction , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Badrinath Roysam,et al.  3-D Image Pre-processing Algorithms for Improved Automated Tracing of Neuronal Arbors , 2011, Neuroinformatics.

[46]  Tianxu Zhang,et al.  Marked Point Process for Vascular Tree Extraction on Angiogram , 2007, EMMCVPR.

[47]  Attila Kuba,et al.  A 3D 6-subiteration thinning algorithm for extracting medial lines , 1998, Pattern Recognit. Lett..

[48]  Jing Xu,et al.  DSA Image Blood Vessel Skeleton Extraction Based on Anti-concentration Diffusion and Level Set Method , 2009 .

[49]  Pascal Fua,et al.  Automated reconstruction of tree structures using path classifiers and Mixed Integer Programming , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[50]  Martin A. Fischler,et al.  Detection of roads and linear structures in low-resolution aerial imagery using a multisource knowledge integration technique☆ , 1981 .

[51]  Badrinath Roysam,et al.  Novel 4-D Open-Curve Active Contour and curve completion approach for automated tree structure extraction , 2011, CVPR 2011.

[52]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Hanchuan Peng,et al.  Automatic reconstruction of 3D neuron structures using a graph-augmented deformable model , 2010, Bioinform..

[54]  Thomas Stützle,et al.  Ant Colony Optimization , 2009, EMO.

[55]  Laurent D. Cohen,et al.  Tubular Structure Segmentation Based on Minimal Path Method and Anisotropic Enhancement , 2011, International Journal of Computer Vision.

[56]  Stephen T. C. Wong,et al.  Repulsive force based snake model to segment and track neuronal axons in 3D microscopy image stacks , 2006, NeuroImage.

[57]  R. S. Stoica,et al.  Detecting filamentary pattern in the cosmic web: a catalogue of filaments for the SDSS , 2013, 1308.2533.

[58]  Emanuele Trucco,et al.  Robust optic disc location via combination of weak detectors , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[59]  Marco Dorigo Ant colony optimization , 2004, Scholarpedia.

[60]  Richard I. Hartley,et al.  Tracking of Blood Vessels in Retinal Images Using Kalman Filter , 2008, 2008 Digital Image Computing: Techniques and Applications.

[61]  Hanchuan Peng,et al.  V3D enables real-time 3D visualization and quantitative analysis of large-scale biological image data sets , 2010, Nature Biotechnology.

[62]  Pascal Fua,et al.  Detecting Irregular Curvilinear Structures in Gray Scale and Color Imagery Using Multi-directional Oriented Flux , 2013, 2013 IEEE International Conference on Computer Vision.

[63]  M. Pool,et al.  NeuriteTracer: A novel ImageJ plugin for automated quantification of neurite outgrowth , 2008, Journal of Neuroscience Methods.

[64]  W. Brent Lindquist,et al.  Automated Algorithms for Multiscale Morphometry of Neuronal Dendrites , 2004, Neural Computation.

[65]  Slawomir J. Nasuto,et al.  Neuromantic – from Semi-Manual to Semi-Automatic Reconstruction of Neuron Morphology , 2012, Front. Neuroinform..