Multi-image Segmentation: A Collaborative Approach Based on Binary Partition Trees

Image segmentation is generally performed in a “one image, one algorithm” paradigm. However, it is sometimes required to consider several images of a same scene, or to carry out several (or several occurrences of a same) algorithm(s) to fully capture relevant information. To solve the induced segmentation fusion issues, various strategies have been already investigated for allowing a consensus between several segmentation outputs. This article proposes a contribution to segmentation fusion, with a specific focus on the “n images” part of the paradigm. Its main originality is to act on the segmentation research space, i.e., to work at an earlier stage than standard segmentation fusion approaches. To this end, an algorithmic framework is developed to build a binary partition tree in a collaborative fashion, from several images, thus allowing to obtain a unified hierarchical segmentation space. This framework is, in particular, designed to embed consensus policies inherited from the machine learning domain. Application examples proposed in remote sensing emphasise the potential usefulness of our approach for satellite image processing.

[1]  Verónica Vilaplana,et al.  Binary Partition Trees for Object Detection , 2008, IEEE Transactions on Image Processing.

[2]  Xiaoyi Jiang,et al.  Image Segmentation Fusion Using General Ensemble Clustering Methods , 2010, ACCV.

[3]  Jörg-Stefan Praßni,et al.  A random walker based approach to combining multiple segmentations , 2008, 2008 19th International Conference on Pattern Recognition.

[4]  Pascal Monasse,et al.  Scale-Space from a Level Lines Tree , 2000, J. Vis. Commun. Image Represent..

[5]  Anil K. Jain,et al.  Clustering ensembles: models of consensus and weak partitions , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Philippe Salembier,et al.  Antiextensive connected operators for image and sequence processing , 1998, IEEE Trans. Image Process..

[7]  Carlos López-Martínez,et al.  PolSAR Time Series Processing With Binary Partition Trees , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Jon Atli Benediktsson,et al.  Hierarchical Analysis of Remote Sensing Data: Morphological Attribute Profiles and Binary Partition Trees , 2011, ISMM.

[9]  Bo Peng,et al.  Bayesian image segmentation fusion , 2014, Knowl. Based Syst..

[10]  Philippe Salembier,et al.  Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval , 2000, IEEE Trans. Image Process..

[11]  Dominique Jeulin,et al.  Stochastic watershed segmentation , 2007, ISMM.

[12]  M.H.F. Wilkinson,et al.  Connected operators , 2009, IEEE Signal Processing Magazine.

[13]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on a Stochastic Minimum Spanning Forest Approach , 2012, IEEE Transactions on Image Processing.

[14]  Jake K. Aggarwal,et al.  The Integration of Image Segmentation Maps using Region and Edge Information , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Pierre Soille,et al.  Constrained connectivity for hierarchical image partitioning and simplification , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Peter Meer,et al.  Image Segmentation from Consensus Information , 1997, Comput. Vis. Image Underst..

[17]  Victor Maojo,et al.  A shape interpolation technique based on inclusion relationships and median sets , 2007, Image Vis. Comput..

[18]  Nicolas Passat,et al.  Extraction of complex patterns from multiresolution remote sensing images: A hierarchical top-down methodology , 2012, Pattern Recognit..