Elucidating the Relations among Seeded Image Segmentation Methods and their Possible Extensions

Many image segmentation algorithms have been proposed, specially for the case of binary segmentation (object/background) in which hard constraints (seeds) are provided interactively. Recently, several theoretical efforts were made in an attempt to unify their presentation and clarify their relations. These relations are usually pointed out textually or depicted in the form of a table of parameters of a general energy formulation. In this work we introduce a more general diagram representation which captures the connections among the methods, by means of conventional relations from set theory. We formally instantiate several methods under this diagram, including graph cuts, power watersheds, fuzzy connectedness, grow cut, distance cuts, and others, which are usually presented as unrelated methods. The proposed diagram representation leads to a more elucidated view of the methods, being less restrictive than the tabular representation. It includes new relations among methods, besides bringing together the connections gathered from different works. It also points out some promising unexplored intermediate regions, which can lead to possible extensions of the existing methods. We also demonstrate one of such possible extensions, which is used to effectively combine the strengths of region and local contrast features.

[1]  Hyung Woo Kang,et al.  G-wire: A livewire segmentation algorithm based on a generalized graph formulation , 2005, Pattern Recognit. Lett..

[2]  Alexandre X. Falcão,et al.  The Ordered Queue and the Optimality of the Watershed Approaches , 2000, ISMM.

[3]  Gabriel Taubin,et al.  Interactive 3D ScanningWithout Tracking , 2007 .

[4]  Vladimir Vezhnevets,et al.  “GrowCut” - Interactive Multi-Label N-D Image Segmentation By Cellular Automata , 2005 .

[5]  Alexandre X. Falcão,et al.  Interactive volume segmentation with differential image foresting transforms , 2004, IEEE Transactions on Medical Imaging.

[6]  Alexandre X. Falcão,et al.  The riverbed approach for user-steered image segmentation , 2011, 2011 18th IEEE International Conference on Image Processing.

[7]  Camille Couprie,et al.  Power watersheds: A new image segmentation framework extending graph cuts, random walker and optimal spanning forest , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[8]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Alexandre X. Falcão,et al.  Links Between Image Segmentation Based on Optimum-Path Forest and Minimum Cut in Graph , 2009, Journal of Mathematical Imaging and Vision.

[10]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[11]  Alexandre X. Falcão,et al.  The Image Forest Transform Architecture , 2007, 2007 International Conference on Field-Programmable Technology.

[12]  Jayaram K. Udupa,et al.  Relative Fuzzy Connectedness among Multiple Objects: Theory, Algorithms, and Applications in Image Segmentation , 2001, Comput. Vis. Image Underst..

[13]  Jos B. T. M. Roerdink,et al.  The Watershed Transform: Definitions, Algorithms and Parallelization Strategies , 2000, Fundam. Informaticae.

[14]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[15]  Filip Malmberg,et al.  A 3D Live-Wire Segmentation Method for Volume Images Using Haptic Interaction , 2006, DGCI.

[16]  Laurent D. Cohen,et al.  Global Minimum for Active Contour Models: A Minimal Path Approach , 1997, International Journal of Computer Vision.

[17]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid , 2012 .

[18]  Guillermo Sapiro,et al.  Distancecut: Interactive Real-Time Segmentation and Matting of Images and Videos (PREPRINT) , 2007 .

[19]  Jayaram K. Udupa,et al.  Affinity functions in fuzzy connectedness based image segmentation II: Defining and recognizing truly novel affinities , 2010, Comput. Vis. Image Underst..

[20]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Alex M. Andrew,et al.  Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid Mechanics, Computer Vision, and Materials Science (2nd edition) , 2000 .

[22]  Gilles Bertrand,et al.  Watershed Cuts: Thinnings, Shortest Path Forests, and Topological Watersheds , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Gilles Bertrand,et al.  Watershed Cuts: Minimum Spanning Forests and the Drop of Water Principle , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Jayaram K. Udupa,et al.  Relative Fuzzy Connectedness and Object Definition: Theory, Algorithms, and Applications in Image Segmentation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Michel Couprie,et al.  Some links between min-cuts, optimal spanning forests and watersheds , 2007, ISMM.

[26]  Supun Samarasekera,et al.  Fuzzy Connectedness and Object Definition: Theory, Algorithms, and Applications in Image Segmentation , 1996, CVGIP Graph. Model. Image Process..

[27]  William A. Barrett,et al.  Interactive Segmentation with Intelligent Scissors , 1998, Graph. Model. Image Process..

[28]  Alexandre X. Falcão,et al.  IFT-Watershed from gray-scale marker , 2002, Proceedings. XV Brazilian Symposium on Computer Graphics and Image Processing.

[29]  Jayaram K. Udupa,et al.  Cloud bank: A multiple clouds model and its use in MR brain image segmentation , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[30]  Jayaram K. Udupa,et al.  Comparison of fuzzy connectedness and graph cut segmentation algorithms , 2011, Medical Imaging.

[31]  Jayaram K. Udupa,et al.  User-Steered Image Segmentation Paradigms: Live Wire and Live Lane , 1998, Graph. Model. Image Process..

[32]  Jayaram K. Udupa,et al.  An ultra-fast user-steered image segmentation paradigm: live wire on the fly , 2000, IEEE Transactions on Medical Imaging.

[33]  Anderson Rocha,et al.  Object Delineation by -Connected Components , 2008, EURASIP J. Adv. Signal Process..

[34]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[35]  Roberto de Alencar Lotufo,et al.  Watershed by image foresting transform, tie-zone, and theoretical relationships with other watershed definitions , 2007, ISMM.

[36]  Leo Grady,et al.  A Seeded Image Segmentation Framework Unifying Graph Cuts And Random Walker Which Yields A New Algorithm , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[37]  Jayaram K. Udupa,et al.  Affinity functions in fuzzy connectedness based image segmentation I: Equivalence of affinities , 2010, Comput. Vis. Image Underst..

[38]  Roberto de Alencar Lotufo,et al.  Seed-Relative Segmentation Robustness of Watershed and Fuzzy Connectedness Approaches , 2007 .

[39]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Camille Couprie,et al.  Power Watershed: A Unifying Graph-Based Optimization Framework , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  J. Sethian Curvature and the evolution of fronts , 1985 .

[42]  Jorge Stolfi,et al.  The image foresting transform: theory, algorithms, and applications , 2004 .

[43]  Leo Grady,et al.  Minimal Surfaces Extend Shortest Path Segmentation Methods to 3D , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[45]  Jayaram K. Udupa,et al.  Iterative relative fuzzy connectedness for multiple objects with multiple seeds , 2007, Comput. Vis. Image Underst..