Optimizing multiscale segmentation with local spectral heterogeneity measure for high resolution remote sensing images

Abstract Image segmentation is a vital and fundamental step in Geographic Object-Based Image Analysis (GEOBIA). Many multiscale segmentation algorithms have been widely used in high resolution (HR) remote sensing images. These segmentation algorithms need a preset parameter, named scale parameter, to control the average size of each object. However, due to the spatial variation, single scale parameter can hardly describe the boundaries of regions with different land covers. To overcome this limitation, in this study, an adaptive parameter optimization method is proposed for multiscale segmentation. To find the optimal scale of objects, a local spectral heterogeneity measure is applied by calculating the spectral angle between inter and intra objects. Different from selecting a global optimal scale parameter, this study aims to directly search the optimal objects from results of all different scales and combine them into final segmentation results. In experiments, a multi-resolution segmentation is used to generate segmentation results of different scales and the QuickBird-2 images are used as test data. Optimization results over four HR test images reveal that the proposed method provides better segmentation performance than single scale segmentation result.

[1]  Li Feng,et al.  Toward Evaluating Multiscale Segmentations of High Spatial Resolution Remote Sensing Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Peijun Du,et al.  A review of supervised object-based land-cover image classification , 2017 .

[3]  D. Civco,et al.  Optimizing multi-resolution segmentation scale using empirical methods: Exploring the sensitivity of the supervised discrepancy measure Euclidean distance 2 (ED2) , 2014 .

[4]  Angelos Tzotsos,et al.  MSEG: A GENERIC REGION-BASED MULTI-SCALE IMAGE SEGMENTATION ALGORITHM FOR REMOTE SENSING IMAGERY , 2006 .

[5]  Dirk Tiede,et al.  ESP: a tool to estimate scale parameter for multiresolution image segmentation of remotely sensed data , 2010, Int. J. Geogr. Inf. Sci..

[6]  Caspar A. Mücher,et al.  SegOptim - A new R package for optimizing object-based image analyses of high-spatial resolution remotely-sensed data , 2019, Int. J. Appl. Earth Obs. Geoinformation.

[7]  Brian Johnson,et al.  Unsupervised image segmentation evaluation and refinement using a multi-scale approach , 2011 .

[8]  Georgios Tziritas,et al.  MRF-based segmentation and unsupervised classification for building and road detection in peri-urban areas of high-resolution satellite images , 2016 .

[9]  Guifeng Zhang,et al.  An Edge Embedded Marker-Based Watershed Algorithm for High Spatial Resolution Remote Sensing Image Segmentation , 2010, IEEE Transactions on Image Processing.

[10]  Pierre Gançarski,et al.  Remote sensing image analysis by aggregation of segmentation-classification collaborative agents , 2018, Pattern Recognit..

[11]  Giles M. Foody,et al.  Using mixed objects in the training of object-based image classifications , 2017 .

[12]  Jian Yang,et al.  Region Merging Considering Within- and Between-Segment Heterogeneity: An Improved Hybrid Remote-Sensing Image Segmentation Method , 2018, Remote. Sens..

[13]  Guifeng Zhang,et al.  A Scale-Synthesis Method for High Spatial Resolution Remote Sensing Image Segmentation , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Min Zhang,et al.  Scale parameter selection by spatial statistics for GeOBIA: Using mean-shift based multi-scale segmentation as an example , 2015 .

[15]  Dongmei Chen,et al.  Segmentation for Object-Based Image Analysis (OBIA): A review of algorithms and challenges from remote sensing perspective , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[16]  Xuezhi Feng,et al.  An Unsupervised Evaluation Method for Remotely Sensed Imagery Segmentation , 2012, IEEE Geoscience and Remote Sensing Letters.

[17]  Fred A. Kruse,et al.  The Spectral Image Processing System (SIPS) - Interactive visualization and analysis of imaging spectrometer data , 1993 .

[18]  Tengfei Su,et al.  Scale-variable region-merging for high resolution remote sensing image segmentation , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[19]  Geoffrey J. Hay,et al.  Geographic object-based image analysis (GEOBIA): emerging trends and future opportunities , 2018 .

[20]  Xueliang Zhang,et al.  Segmentation quality evaluation using region-based precision and recall measures for remote sensing images , 2015 .

[21]  Rui Hu,et al.  Multiscale Optimized Segmentation of Urban Green Cover in High Resolution Remote Sensing Image , 2018, Remote. Sens..

[22]  Iryna Dronova,et al.  Object-Based Image Analysis in Wetland Research: A Review , 2015, Remote. Sens..

[23]  Peijun Li,et al.  A new segmentation method for very high resolution imagery using spectral and morphological information , 2015 .

[24]  Jason W. Karl,et al.  Spatial dependence of predictions from image segmentation: A variogram-based method to determine appropriate scales for producing land-management information , 2010, Ecol. Informatics.

[25]  Jaime S. Cardoso,et al.  Toward a generic evaluation of image segmentation , 2005, IEEE Transactions on Image Processing.

[26]  Shengwei Zhang,et al.  Local and global evaluation for remote sensing image segmentation , 2017 .

[27]  R. Pu,et al.  A comparative analysis of high spatial resolution IKONOS and WorldView-2 imagery for mapping urban tree species , 2012 .

[28]  Li Feng,et al.  Adaptive Scale Selection for Multiscale Segmentation of Satellite Images , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Jian Yang,et al.  A discrepancy measure for segmentation evaluation from the perspective of object recognition , 2015 .

[30]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[31]  Lei Ma,et al.  Training set size, scale, and features in Geographic Object-Based Image Analysis of very high resolution unmanned aerial vehicle imagery , 2015 .

[32]  Clement Atzberger,et al.  On the Objectivity of the Objective Function - Problems with Unsupervised Segmentation Evaluation Based on Global Score and a Possible Remedy , 2017, Remote. Sens..

[33]  Antônio Miguel Vieira Monteiro,et al.  Parameter selection for region‐growing image segmentation algorithms using spatial autocorrelation , 2006 .

[34]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[35]  Jian Yang,et al.  A multi-band approach to unsupervised scale parameter selection for multi-scale image segmentation , 2014 .

[36]  Patricia Gober,et al.  Per-pixel vs. object-based classification of urban land cover extraction using high spatial resolution imagery , 2011, Remote Sensing of Environment.

[37]  Jie Tian,et al.  Optimization in multi‐scale segmentation of high‐resolution satellite images for artificial feature recognition , 2007 .

[38]  Zengzhou Hao,et al.  Edge-Guided Image Object Detection in Multiscale Segmentation for High-Resolution Remotely Sensed Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Bo Wang,et al.  Discrepancy measures for selecting optimal combination of parameter values in object-based image analysis , 2012 .

[40]  Alfred Stein,et al.  Complexity metrics to quantify semantic accuracy in segmented Landsat images , 2005 .

[41]  Jianyu Chen,et al.  Image‐object detectable in multiscale analysis on high‐resolution remotely sensed imagery , 2009 .

[42]  Daniel L. Civco,et al.  Evaluation of data fusion and image segmentation in earth observation based rapid mapping workflows , 2014 .

[43]  Ying Liu,et al.  Unsupervised segmentation parameter selection using the local spatial statistics for remote sensing image segmentation , 2019, Int. J. Appl. Earth Obs. Geoinformation.

[44]  Qihao Weng,et al.  An Automated Method to Parameterize Segmentation Scale by Enhancing Intrasegment Homogeneity and Intersegment Heterogeneity , 2015, IEEE Geoscience and Remote Sensing Letters.

[45]  R. Congalton,et al.  A comparison of unsupervised segmentation parameter optimization approaches using moderate- and high-resolution imagery , 2017 .

[46]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Qingquan Li,et al.  Stepwise Evolution Analysis of the Region-Merging Segmentation for Scale Parameterization , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[48]  Sabine Vanhuysse,et al.  Scale Matters: Spatially Partitioned Unsupervised Segmentation Parameter Optimization for Large and Heterogeneous Satellite Images , 2018, Remote. Sens..

[49]  Sabine Vanhuysse,et al.  Normalization in Unsupervised Segmentation Parameter Optimization: A Solution Based on Local Regression Trend Analysis , 2018, Remote. Sens..