Random walkers on morphological trees: A segmentation paradigm

Abstract The problem of image segmentation is often considered in the framework of graphs. In this context, two main paradigms exist: in the first, the vertices of a non-directed graph represent the pixels (leading e.g. to the watershed, the random walker or the graph cut approaches); in the second, the vertices of a directed graph represent the connected regions, leading to the so-called morphological trees (e.g. the component-trees or the trees of shapes). Various approaches have been proposed for carrying out segmentation from images modeled by such morphological trees, by computing cuts of these trees or by selecting relevant nodes from descriptive attributes. In this article, we propose a new way of carrying out segmentation from morphological trees. Our approach is dedicated to take advantage of the morphological tree of an image, enriched by multiple attributes in each node, by using maximally stable extremal regions and random walker paradigms for defining an optimal cut leading to a final segmentation. Experiments, carried out on multimodal medical images emphasize the potential relevance of this approach.

[1]  Hugues Talbot,et al.  Directed Connected Operators: Asymmetric Hierarchies for Image Filtering and Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Fernand Meyer,et al.  The Viscous Watershed Transform , 2005, Journal of Mathematical Imaging and Vision.

[3]  J. A. Sethian,et al.  Fast Marching Methods , 1999, SIAM Rev..

[4]  Michael H. F. Wilkinson,et al.  Vector-Attribute Filters , 2005, ISMM.

[5]  Thierry Géraud,et al.  MToS: A Tree of Shapes for Multivariate Images , 2015, IEEE Transactions on Image Processing.

[6]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Hugues Talbot,et al.  Shape-Based Analysis on Component-Graphs for Multivalued Image Processing , 2015, ISMM.

[8]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[9]  Ronaldo Fumio Hashimoto,et al.  Efficient component-hypertree construction based on hierarchy of partitions , 2020, Pattern Recognit. Lett..

[10]  Nicolas Passat,et al.  Connected Filtering Based on Multivalued Component-Trees , 2014, IEEE Transactions on Image Processing.

[11]  Jean Paul Frédéric Serra,et al.  Hierarchies and Optima , 2011, DGCI.

[12]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Jocelyn Chanussot,et al.  Braids of partitions for the hierarchical representation and segmentation of multimodal images , 2019, Pattern Recognit..

[14]  Philippe Salembier,et al.  Antiextensive connected operators for image and sequence processing , 1998, IEEE Trans. Image Process..

[15]  Yongchao Xu,et al.  Connected Filtering on Tree-Based Shape-Spaces , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Christophe Collet,et al.  Hyperconnections and Hierarchical Representations for Grayscale and Multiband Image Processing , 2012, IEEE Transactions on Image Processing.

[17]  Michael H. F. Wilkinson,et al.  Volumetric Attribute Filtering and Interactive Visualization Using the Max-Tree Representation , 2007, IEEE Transactions on Image Processing.

[18]  Gilles Bertrand,et al.  Watershed Cuts: Minimum Spanning Forests and the Drop of Water Principle , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Nicolas Passat,et al.  Component-Trees and Multivalued Images: Structural Properties , 2013, Journal of Mathematical Imaging and Vision.

[20]  Supun Samarasekera,et al.  Fuzzy Connectedness and Object Definition: Theory, Algorithms, and Applications in Image Segmentation , 1996, CVGIP Graph. Model. Image Process..

[21]  Nicolas Passat,et al.  Interactive segmentation based on component-trees , 2011, Pattern Recognit..

[22]  Hervé Le Men,et al.  Scale-Sets Image Analysis , 2005, International Journal of Computer Vision.

[23]  Hugues Talbot,et al.  Path Openings and Closings , 2005, Journal of Mathematical Imaging and Vision.

[24]  Joe Y. Chang,et al.  GTV spatial conformity between different delineation methods by 18FDG PET/CT and pathology in esophageal cancer. , 2009, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[25]  Nicolas Passat,et al.  Component-Hypertrees for Image Segmentation , 2011, ISMM.

[26]  Benjamin Perret,et al.  Playing with Kruskal: Algorithms for Morphological Trees in Edge-Weighted Graphs , 2013, ISMM.

[27]  Jean Paul Frédéric Serra,et al.  Braids of Partitions , 2015, ISMM.

[28]  Ronald Jones,et al.  Connected Filtering and Segmentation Using Component Trees , 1999, Comput. Vis. Image Underst..

[29]  Camille Couprie,et al.  Power Watershed: A Unifying Graph-Based Optimization Framework , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Philippe Salembier,et al.  Flat zones filtering, connected operators, and filters by reconstruction , 1995, IEEE Trans. Image Process..

[31]  Benjamin Perret,et al.  Evaluation of Hierarchical Watersheds , 2018, IEEE Transactions on Image Processing.

[32]  Ursula Nestle,et al.  Target volume definition for 18F-FDG PET-positive lymph nodes in radiotherapy of patients with non-small cell lung cancer , 2007, European Journal of Nuclear Medicine and Molecular Imaging.

[33]  Pascal Monasse,et al.  Scale-Space from a Level Lines Tree , 2000, J. Vis. Commun. Image Represent..

[34]  Ronald Jones,et al.  Attribute Openings, Thinnings, and Granulometries , 1996, Comput. Vis. Image Underst..

[35]  Hugues Talbot,et al.  Automated 3D lymphoma lesion segmentation from PET/CT characteristics , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[36]  Thierry Géraud,et al.  A Comparative Review of Component Tree Computation Algorithms , 2014, IEEE Transactions on Image Processing.

[37]  Nicolas Passat,et al.  Binary Partition Tree construction from multiple features for image segmentation , 2018, Pattern Recognit..

[38]  Nicolas Passat,et al.  Component-Graph Construction , 2019, Journal of Mathematical Imaging and Vision.

[39]  Laurent Najman,et al.  Extending the Power Watershed Framework Thanks to Γ-Convergence , 2017, SIAM J. Imaging Sci..

[40]  Xinjian Chen,et al.  Joint segmentation of anatomical and functional images: Applications in quantification of lesions from PET, PET-CT, MRI-PET, and MRI-PET-CT images , 2013, Medical Image Anal..

[41]  Hugues Talbot,et al.  Shaping for PET image analysis , 2020, Pattern Recognit. Lett..

[42]  Pascal Monasse,et al.  Tree-Based Morse Regions: A Topological Approach to Local Feature Detection , 2014, IEEE Transactions on Image Processing.

[43]  Ulas Bagci,et al.  A review on segmentation of positron emission tomography images , 2014, Comput. Biol. Medicine.

[44]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  David Cárdenas-Peña,et al.  Waterpixels , 2015, IEEE Transactions on Image Processing.

[47]  Xinjian Chen,et al.  Random Walk and Graph Cut for Co-Segmentation of Lung Tumor on PET-CT Images , 2015, IEEE Transactions on Image Processing.

[48]  Jean Cousty,et al.  A graph-based mathematical morphology reader , 2014, Pattern Recognit. Lett..

[49]  Isabelle Bloch,et al.  Brain Lesion Detection in 3D PET Images Using Max-Trees and a New Spatial Context Criterion , 2017, ISMM.

[50]  Philippe Salembier,et al.  Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval , 2000, IEEE Trans. Image Process..

[51]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[52]  Pierre Soille,et al.  Constrained connectivity for hierarchical image partitioning and simplification , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.