Adaptive scale selection in multiscale segmentation based on the segmented object complexity of GF-2 satellite image

Image segmentation is the premise and key step of object-oriented classification, but scale selection remains a challenge in image segmentation. Over the years, scale selection methods of image segmentation have been extensively explored and developed. When the scale is chosen, all the features are generally extracted from images in these methods. In addition, in these methods, an optimal scale is generally selected based on the pre-estimation of the statistical variance of remote sensing images or determined by the post-segmentation evaluation results, rather than during the segmentation. In this study, with the central and eastern parts of Longchang City in Mid-Sichuan Hilly Region as the study area, based on the Gaofen-2 (GF-2) image, an adaptive scale selection method was proposed to determine the optimal scale of each segmentation object during the segmentation. First, the single-scale optimal image segmentation is determined by an unsupervised evaluation method which uses weighted variance and Moran’s I to measure global intra-segment homogeneity and inter-segment heterogeneity, respectively. Then, spectral, texture, and shape features of each segmented object were extracted to construct the complexity index function, and the optimal scale of the segmentation objects was determined through the iterative calculation according to the threshold value. The proposed method was applied to process GF-2 image to obtain the segmentation results and classification map, compared with the methods of determining the optimal scale through estimation local statistic variances of image and post-evaluation of segmentation results. The experimental results showed that the proposed method is of practical helpfulness and effectiveness for generating the optimal scale matching the actual ground objects.

[1]  Y. Zhang,et al.  A REVIEW ON IMAGE SEGMENTATION TECHNIQUES WITH REMOTE SENSING PERSPECTIVE , 2010 .

[2]  Yao Wei,et al.  Application of multispectral remote sensing technology in surface water body extraction , 2016, 2016 International Conference on Audio, Language and Image Processing (ICALIP).

[3]  Yan Gao,et al.  Optimal region growing segmentation and its effect on classification accuracy , 2011 .

[4]  Runhe Shi,et al.  Automatic Selection of Optimal Segmentation Scale of High-resolution Remote Sensing Images , 2013 .

[5]  Antônio Miguel Vieira Monteiro,et al.  Parameter selection for region‐growing image segmentation algorithms using spatial autocorrelation , 2006 .

[6]  Steven E. Franklin,et al.  A comparison of pixel-based and object-based image analysis with selected machine learning algorithms for the classification of agricultural landscapes using SPOT-5 HRG imagery , 2012 .

[7]  Li Feng,et al.  Toward Evaluating Multiscale Segmentations of High Spatial Resolution Remote Sensing Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Timothy A. Warner,et al.  Estimation of optimal image object size for the segmentation of forest stands with multispectral IKONOS imagery , 2008 .

[9]  Brian Johnson,et al.  Unsupervised image segmentation evaluation and refinement using a multi-scale approach , 2011 .

[10]  Zhihua Wang,et al.  Exponentially sampling scale parameters for the efficient segmentation of remote-sensing images , 2018 .

[11]  Li Feng,et al.  Adaptive Scale Selection for Multiscale Segmentation of Satellite Images , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Jian Yang,et al.  A discrepancy measure for segmentation evaluation from the perspective of object recognition , 2015 .

[13]  Min Zhang,et al.  Scale parameter selection by spatial statistics for GeOBIA: Using mean-shift based multi-scale segmentation as an example , 2015 .

[14]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[15]  Markku Kuitunen,et al.  What makes segmentation good? A case study in boreal forest habitat mapping , 2013 .

[16]  Yang Chen,et al.  Extraction of Urban Water Bodies from High-Resolution Remote-Sensing Imagery Using Deep Learning , 2018 .

[17]  Kannan,et al.  ON IMAGE SEGMENTATION TECHNIQUES , 2022 .

[18]  C. Woodcock,et al.  The factor of scale in remote sensing , 1987 .

[19]  M. Charlton,et al.  Quantitative geography : perspectives on spatial data analysis by , 2001 .

[20]  Dirk Tiede,et al.  ESP: a tool to estimate scale parameter for multiresolution image segmentation of remotely sensed data , 2010, Int. J. Geogr. Inf. Sci..

[21]  Xuezhi Feng,et al.  An Unsupervised Evaluation Method for Remotely Sensed Imagery Segmentation , 2012, IEEE Geoscience and Remote Sensing Letters.

[22]  P. Gong,et al.  Accuracy Assessment Measures for Object-based Image Segmentation Goodness , 2010 .

[23]  Delu Pan,et al.  Edge-Guided Multiscale Segmentation of Satellite Multispectral Imagery , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Xiaoxiao Li,et al.  Object-Based Land-Cover Mapping with High Resolution Aerial Photography at a County Scale in Midwestern USA , 2014, Remote. Sens..

[25]  Daniel L. Civco,et al.  Evaluation of data fusion and image segmentation in earth observation based rapid mapping workflows , 2014 .

[26]  Tian Jing,et al.  Selection of best-fitting scale parameters in image segmentation based on multiscale segmentation image database , 2016 .

[27]  Xiao-Dong Hu,et al.  Multiscale Water Body Extraction in Urban Environments From Satellite Images , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  O. Csillik,et al.  Automated parameterisation for multi-scale image segmentation on multiple layers , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[29]  Nicolas Passat,et al.  Extraction of complex patterns from multiresolution remote sensing images: A hierarchical top-down methodology , 2012, Pattern Recognit..

[30]  Adam C. Winstanley,et al.  Segmentation performance evaluation for object-based remotely sensed image analysis , 2010 .

[31]  Ying Liu,et al.  Landscape analysis of wetland plant functional types: The effects of image segmentation scale, vegetation classes and classification methods , 2012 .

[32]  Calvin C. Gotlieb,et al.  Texture descriptors based on co-occurrence matrices , 1990, Comput. Vis. Graph. Image Process..

[33]  Wang Di,et al.  Supervised evaluation of optimal segmentation scale with object-oriented method in remote sensing image , 2016 .

[34]  Jie Chen,et al.  A new regional shape index for classification of high resolution remote sensing images , 2014, 2014 Third International Workshop on Earth Observation and Remote Sensing Applications (EORSA).

[35]  Wenzhong Shi,et al.  Quality assessment for geo‐spatial objects derived from remotely sensed data , 2005 .

[36]  Clement Atzberger,et al.  Object Based Image Analysis and Data Mining applied to a remotely sensed Landsat time-series to map sugarcane over large areas , 2012 .

[37]  Bo Wang,et al.  Discrepancy measures for selecting optimal combination of parameter values in object-based image analysis , 2012 .

[38]  Hui Zhang,et al.  Image segmentation evaluation: A survey of unsupervised methods , 2008, Comput. Vis. Image Underst..

[39]  A. Sekar,et al.  A Survey on Image Segmentation Techniques , 2015 .

[40]  Lorenzo Bruzzone,et al.  A Novel Protocol for Accuracy Assessment in Classification of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Liangpei Zhang,et al.  An Adaptive Mean-Shift Analysis Approach for Object Extraction and Classification From Urban Hyperspectral Imagery , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[43]  Jian Yang,et al.  A multi-band approach to unsupervised scale parameter selection for multi-scale image segmentation , 2014 .

[44]  Patricia Gober,et al.  Per-pixel vs. object-based classification of urban land cover extraction using high spatial resolution imagery , 2011, Remote Sensing of Environment.

[45]  Jun Li,et al.  Object-based land cover mapping using adaptive scale segmentation from ZY-3 satellite images , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[46]  Wei Gao,et al.  Automatic selection of optimal segmentation scales for high-resolution remote sensing images , 2013, Optics & Photonics - Optical Engineering + Applications.

[47]  M. Neubert,et al.  Enhanced evaluation of image segmentation results , 2010 .

[48]  Bo Wu,et al.  Quantitatively Evaluating Indexes for Object-based Segmentation of High Spatial Resolution Image , 2013 .