Efficient Image Segmentation in Graphs with Localized Curvilinear Features

In graph-based image segmentation, the arc weights are given by a local edge indicator function based on image attributes and prior object information. In boundary tracking methods, an edge integration process combines local edges into meaningful long edge curves, interconnecting a set of anchor points, such that a closed contour is computed for segmentation. In this work, we show that multiple short-range edge integrations can extract curvilinear features all over the image to improve seeded region-based segmentation. We demonstrate these results using edge integration by Live Wire (LW), combined with Oriented Image Foresting Transform (OIFT), due to their complementary strengths. As result, we have a globally optimal segmentation, that can be tailored to a given target object, according to its localized curvilinear features.

[1]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[2]  Paulo André Vechiatto Miranda,et al.  Image segmentation by image foresting transform with geodesic band constraints , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[3]  Lucy A. C. Mansilla,et al.  Image Segmentation by Oriented Image Foresting Transform with Geodesic Star Convexity , 2013, CAIP.

[4]  Hyung Woo Kang,et al.  G-wire: A livewire segmentation algorithm based on a generalized graph formulation , 2005, Pattern Recognit. Lett..

[5]  Wenxian Yang,et al.  User-Friendly Interactive Image Segmentation Through Unified Combinatorial User Inputs , 2010, IEEE Transactions on Image Processing.

[6]  Lucy A. C. Mansilla,et al.  Bandeirantes: A Graph-Based Approach for Curve Tracing and Boundary Tracking , 2017, ISMM.

[7]  Olivier Lezoray,et al.  Image Processing and Analysis With Graphs: theory and Practice , 2017 .

[8]  Daniel Cremers,et al.  Curvature regularity for region-based image segmentation and inpainting: A linear programming relaxation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[9]  Paulo André Vechiatto Miranda,et al.  Oriented relative fuzzy connectedness: theory, algorithms, and its applications in hybrid image segmentation methods , 2015, EURASIP J. Image Video Process..

[10]  Jayaram K. Udupa,et al.  Affinity functions in fuzzy connectedness based image segmentation II: Defining and recognizing truly novel affinities , 2010, Comput. Vis. Image Underst..

[11]  Jayaram K. Udupa,et al.  Affinity functions in fuzzy connectedness based image segmentation I: Equivalence of affinities , 2010, Comput. Vis. Image Underst..

[12]  Jorge Stolfi,et al.  The image foresting transform: theory, algorithms, and applications , 2004 .

[13]  Gilles Bertrand,et al.  Watershed Cuts: Thinnings, Shortest Path Forests, and Topological Watersheds , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Alexandre X. Falcão,et al.  Hybrid Approaches for Interactive Image Segmentation Using the Live Markers Paradigm , 2014, IEEE Trans. Image Process..

[15]  Pedro Jussieu de Rezende,et al.  Interactive Segmentation by Image Foresting Transform on Superpixel Graphs , 2013, 2013 XXVI Conference on Graphics, Patterns and Images.

[16]  Jayaram K. Udupa,et al.  Synergistic arc-weight estimation for interactive image segmentation using graphs , 2010, Comput. Vis. Image Underst..

[17]  Andrew Blake,et al.  Geodesic star convexity for interactive image segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Alexandre X. Falcão,et al.  IFT-SLIC: A General Framework for Superpixel Generation Based on Simple Linear Iterative Clustering and Image Foresting Transform , 2015, 2015 28th SIBGRAPI Conference on Graphics, Patterns and Images.

[19]  Lucy A. C. Mansilla,et al.  Oriented Image Foresting Transform Segmentation by Seed Competition , 2014, IEEE Transactions on Image Processing.

[20]  Camille Couprie,et al.  Power Watershed: A Unifying Graph-Based Optimization Framework , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Ayman El-Baz,et al.  Biomedical Image Segmentation : Advances and Trends , 2016 .

[22]  Lucy A. C. Mansilla,et al.  Oriented image foresting transform segmentation with connectivity constraints , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[23]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Jayaram K. Udupa,et al.  Joint graph cut and relative fuzzy connectedness image segmentation algorithm , 2013, Medical Image Anal..

[25]  Jayaram K. Udupa,et al.  A unifying graph-cut image segmentation framework: algorithms it encompasses and equivalences among them , 2012, Medical Imaging.

[26]  Ullrich Köthe,et al.  Learned Watershed: End-to-End Learning of Seeded Segmentation , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[27]  Alexandre X. Falcão,et al.  Riverbed: A Novel User-Steered Image Segmentation Method Based on Optimum Boundary Tracking , 2012, IEEE Transactions on Image Processing.

[28]  Lucy A. C. Mansilla,et al.  Image segmentation by oriented image foresting transform: Handling ties and colored images , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[29]  Jayaram K. Udupa,et al.  Fuzzy Connectedness Image Segmentation in Graph Cut Formulation: A Linear-Time Algorithm and a Comparative Analysis , 2012, Journal of Mathematical Imaging and Vision.

[30]  Jian Yang,et al.  Image segmentation by iterated region merging with localized graph cuts , 2011, Pattern Recognit..

[31]  Lucy A. C. Mansilla,et al.  Oriented Image Foresting Transform Segmentation: Connectivity Constraints with Adjustable Width , 2016, 2016 29th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[32]  Jayaram K. Udupa,et al.  An ultra-fast user-steered image segmentation paradigm: live wire on the fly , 2000, IEEE Transactions on Medical Imaging.

[33]  Jayaram K. Udupa,et al.  Iterative relative fuzzy connectedness for multiple objects with multiple seeds , 2007, Comput. Vis. Image Underst..