Boundary-constrained multi-scale segmentation method for remote sensing images

Abstract Image segmentation is the key step of Object-Based Image Analysis (OBIA) in remote sensing. This paper proposes a Boundary-Constrained Multi-Scale Segmentation (BCMS) method. Firstly, adjacent pixels are aggregated to generate initial segmentation according to the local best region growing strategy. Then, the Region Adjacency Graph (RAG) is built based on initial segmentation. Finally, the local mutual best region merging strategy is applied on RAG to produce multi-scale segmentation results. During the region merging process, a Step-Wise Scale Parameter (SWSP) strategy is proposed to produce boundary-constrained multi-scale segmentation results. Moreover, in order to improve the accuracy of object boundaries, the property of edge strength is introduced as a merging criterion. A set of high spatial resolution remote sensing images is used in the experiment, e.g., QuickBird, WorldView, and aerial image, to evaluate the effectiveness of the proposed method. The segmentation results of BCMS are compared with those of the commercial image analysis software eCognition. The experiment shows that BCMS can produce nested multi-scale segmentations with accurate and smooth boundaries, which proves the robustness of the proposed method.

[1]  Narendra Ahuja,et al.  Multiscale image segmentation by integrated edge and region detection , 1997, IEEE Trans. Image Process..

[2]  Jan Verbesselt,et al.  Hierarchical image segmentation based on similarity of NDVI time series , 2008 .

[3]  Geoffrey J. Hay,et al.  Multiscale object-specific analysis: Scale problems and multiscale solutions , 2004 .

[4]  Aggelos K. Katsaggelos,et al.  Hybrid image segmentation using watersheds and fast region merging , 1998, IEEE Trans. Image Process..

[5]  Josef Strobl,et al.  What’s wrong with pixels? Some recent developments interfacing remote sensing and GIS , 2001 .

[6]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[7]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[8]  Theodosios Pavlidis,et al.  Integrating region growing and edge detection , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  R. Reulke,et al.  Remote Sensing and Spatial Information Sciences , 2005 .

[10]  Guifeng Zhang,et al.  An Edge Embedded Marker-Based Watershed Algorithm for High Spatial Resolution Remote Sensing Image Segmentation , 2010, IEEE Transactions on Image Processing.

[11]  Nikolaos G. Bourbakis,et al.  A fuzzy region growing approach for segmentation of color images , 1997, Pattern Recognit..

[12]  Xavier Cufí,et al.  Strategies for image segmentation combining region and boundary information , 2003, Pattern Recognit. Lett..

[13]  Yun Zhang PROBLEMS IN THE FUSION OF COMMERCIAL HIGH-RESOLUTION SATELLITE AS WELL AS LANDSAT 7 IMAGES AND INITIAL SOLUTIONS , 2002 .

[14]  J. R. Jensen,et al.  An automatic region-based image segmentation algorithm for remote sensing applications , 2010, Environ. Model. Softw..

[15]  Gilberto Câmara,et al.  Spring: integrating remote sensing and gis by object-oriented data modelling , 1996, Comput. Graph..

[16]  G. Hay,et al.  Size-constrained Region Merging (SCRM): An Automated Delineation Tool for Assisted Photointerpretation , 2008 .

[17]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .

[18]  Thomas Blaschke,et al.  A comparison of three image-object methods for the multiscale analysis of landscape structure , 2003 .

[19]  M. Cugmas,et al.  On comparing partitions , 2015 .

[20]  Jianping Fan,et al.  Seeded region growing: an extensive and comparative study , 2005, Pattern Recognit. Lett..

[21]  Frank Y. Shih,et al.  Automatic seeded region growing for color image segmentation , 2005, Image Vis. Comput..

[22]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Jianping Fan,et al.  Automatic image segmentation by integrating color-edge extraction and seeded region growing , 2001, IEEE Trans. Image Process..

[24]  Xiaobo Li,et al.  Adaptive image region-growing , 1994, IEEE Trans. Image Process..

[25]  B. S. Manjunath,et al.  Unsupervised Segmentation of Color-Texture Regions in Images and Video , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Alain Trémeau,et al.  A region growing and merging algorithm to color segmentation , 1997, Pattern Recognit..

[27]  M. Neubert,et al.  Enhanced evaluation of image segmentation results , 2010 .

[28]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[29]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  David A. Clausi,et al.  IRGS: Image Segmentation Using Edge Penalties and Region Growing , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Kannan,et al.  ON IMAGE SEGMENTATION TECHNIQUES , 2022 .

[32]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Geoffrey J. Hay,et al.  Object-based Image Analysis : Strengths , Weaknesses , Opportunities and Threats ( Swot ) , 2006 .

[34]  Anjan Sarkar,et al.  A simple unsupervised MRF model based image segmentation approach , 2000, IEEE Trans. Image Process..

[35]  Morris Goldberg,et al.  Hierarchy in Picture Segmentation: A Stepwise Optimization Approach , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Ying Sun,et al.  A hierarchical approach to color image segmentation using homogeneity , 2000, IEEE Trans. Image Process..

[37]  G. J. Hay,et al.  A multiscale framework for landscape analysis: Object-specific analysis and upscaling , 2001, Landscape Ecology.

[38]  T. Lindeberg,et al.  Scale-Space Theory : A Basic Tool for Analysing Structures at Different Scales , 1994 .

[39]  Jean Louchet,et al.  Using colour, texture, and hierarchial segmentation for high-resolution remote sensing , 2008 .

[40]  Alexandre Carleer,et al.  Assessment of Very High Spatial Resolution Satellite Image Segmentations , 2005 .