Multi-Object Segmentation by Hierarchical Layered Oriented Image Foresting Transform

This paper introduces a new method for multiobject segmentation in images, named as Hierarchical Layered Oriented Image Foresting Transform (HLOIFT). As input, we have an image, a tree of relations between image objects, with the individual high-level priors of each object coded in its nodes, and the objects' seeds. Each node of the tree defines a weighted digraph, named as layer. The layers are then integrated by the geometric interactions, such as inclusion and exclusion relations, extracted from the given tree into a unique weighted digraph, named as hierarchical layered digraph. A single energy optimization is performed in the hierarchical layered weighted digraph by Oriented Image Foresting Transform (OIFT) leading to globally optimal results satisfying all the high-level priors. We evaluate our framework in the multi-object segmentation of medical and synthetic images, obtaining results comparable to the state-of-the-art methods, but with low computational complexity. Compared to multi-object segmentation by min-cut/max-flow algorithm, our approach is less restrictive, leading to globally optimal results in more general scenarios.

[1]  Paulo André Vechiatto Miranda,et al.  Oriented relative fuzzy connectedness: theory, algorithms, and its applications in hybrid image segmentation methods , 2015, EURASIP J. Image Video Process..

[2]  Mark Jenkinson,et al.  Automatic segmentation of the striatum and globus pallidus using MIST: Multimodal Image Segmentation Tool , 2016, NeuroImage.

[3]  Olga Veksler,et al.  Star Shape Prior for Graph-Cut Image Segmentation , 2008, ECCV.

[4]  Jayaram K. Udupa,et al.  Fuzzy model-based body-wide anatomy recognition in medical images , 2013, Medical Imaging.

[5]  Jayaram K. Udupa,et al.  Abdominal adiposity quantification at MRI via fuzzy model-based anatomy recognition , 2013, Medical Imaging.

[6]  Milan Sonka,et al.  Hedgehog Shape Priors for Multi-Object Segmentation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Jorge Stolfi,et al.  The image foresting transform: theory, algorithms, and applications , 2004 .

[8]  Lucy A. C. Mansilla,et al.  Oriented image foresting transform segmentation with connectivity constraints , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[9]  Xiaodong Wu,et al.  LOGISMOS—Layered Optimal Graph Image Segmentation of Multiple Objects and Surfaces: Cartilage Segmentation in the Knee Joint , 2010, IEEE Transactions on Medical Imaging.

[10]  Robert B. Fisher,et al.  Special issue on animal and insect behaviour understanding in image sequences , 2015, EURASIP J. Image Video Process..

[11]  Gilles Bertrand,et al.  Watershed Cuts: Thinnings, Shortest Path Forests, and Topological Watersheds , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Vladimir Kolmogorov,et al.  Graph cut based image segmentation with connectivity priors , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Jayaram K. Udupa,et al.  Automatic thoracic anatomy segmentation on CT images using hierarchical fuzzy models and registration , 2014, Medical Imaging.

[14]  Milan Sonka,et al.  LOGISMOS-B: Layered Optimal Graph Image Segmentation of Multiple Objects and Surfaces for the Brain , 2014, IEEE Transactions on Medical Imaging.

[15]  Jayaram K. Udupa,et al.  Body-wide hierarchical fuzzy modeling, recognition, and delineation of anatomy in medical images , 2014, Medical Image Anal..

[16]  Andrew Blake,et al.  Geodesic star convexity for interactive image segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Jayaram K. Udupa,et al.  Fuzzy object modeling , 2011, Medical Imaging.

[18]  Lucy A. C. Mansilla,et al.  Image segmentation by oriented image foresting transform: Handling ties and colored images , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[19]  Seyedmehrdad Mohammadianrasanani The use of a body-wide automatic anatomy recognition system in image analysis of kidneys , 2013 .

[20]  Lena Gorelick,et al.  Minimizing Energies with Hierarchical Costs , 2012, International Journal of Computer Vision.

[21]  Jayaram K. Udupa,et al.  Fuzzy connectedness and image segmentation , 2003, Proc. IEEE.

[22]  Lucy A. C. Mansilla,et al.  Oriented Image Foresting Transform Segmentation by Seed Competition , 2014, IEEE Transactions on Image Processing.

[23]  Lucy A. C. Mansilla,et al.  Image foresting transform with geodesic star convexity for interactive image segmentation , 2013, 2013 IEEE International Conference on Image Processing.

[24]  Jayaram K. Udupa,et al.  Cloud bank: A multiple clouds model and its use in MR brain image segmentation , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[25]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[26]  Jayaram K. Udupa,et al.  Automatic anatomy recognition via fuzzy object models , 2012, Medical Imaging.

[27]  A. Ardeshir Goshtasby,et al.  A Computer-Aided Design System for Segmentation of Volumetric Images , 2005 .

[28]  Jayaram K. Udupa,et al.  Multiple fuzzy object modeling improves sensitivity in automatic anatomy recognition , 2014, Medical Imaging.

[29]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Lucy A. C. Mansilla,et al.  Image Segmentation by Oriented Image Foresting Transform with Geodesic Star Convexity , 2013, CAIP.

[31]  Leo Grady,et al.  Interactive image segmentation via minimization of quadratic energies on directed graphs , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  David Correa Martins,et al.  A feature selection technique for inference of graphs from their known topological properties: Revealing scale-free gene regulatory networks , 2014, Inf. Sci..

[33]  Fredrik Kahl,et al.  An Efficient Optimization Framework for Multi-Region Segmentation Based on Lagrangian Duality , 2013, IEEE Transactions on Medical Imaging.

[34]  Shiri Gordon,et al.  Co-segmentation of multiple images into multiple regions: Application to mouse brain MRI , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[35]  Yuri Boykov,et al.  Globally optimal segmentation of multi-region objects , 2009, 2009 IEEE 12th International Conference on Computer Vision.