Scale parameter selection by spatial statistics for GeOBIA: Using mean-shift based multi-scale segmentation as an example

Geo-Object-Based Image Analysis (GEOBIA) is becoming an increasingly important technology for information extraction from remote sensing images. Multi-scale image segmentation is a key procedure that partitions an image into homogeneous parcels (image objects) in GEOBIA. Hierarchical image objects also provide a better representation result than a single-scale representation. However, scale selection in multi-scale image segmentation is always difficult for high-performance GEOBIA. This paper first generalizes the commonly used segmentation scale parameters into three aspects: spatial bandwidth (spatial distance between classes), attribute bandwidth (difference between classes) and merging threshold. Next, taking mean-shift multi-scale segmentation as an example, this paper proposes a spatial and spectral statistics-based scale parameter selection method for object-based information extraction from high spatial resolution remote sensing images. The main idea of this proposed method is to use the ALV graph to replace the semivariogram to pre-estimate the optimal spatial bandwidth. Next, the selection of the optimal attribute bandwidth and the merging threshold are based on the ALV histogram and simple geometric computation, respectively. This study uses Ikonos, Quickbird and aerial panchromatic images as the experimental data to verify the validity of the proposed scale parameter selection method. Experiments based on quantitative multi-scale segmentation evaluation testify to the validity of this method. This pre-estimation-based scale parameter selection method is practically helpful and efficient in GEOBIA. The idea of this method can be further extended to other segmentation algorithms and other sensor data.

[1]  M. Baatz,et al.  Object-oriented and Multi-scale Image Analysis in Semantic Networks Introduction: the Necessity for Integration of Remote Sensing and Gis , 2022 .

[2]  Jason W. Karl,et al.  Spatial dependence of predictions from image segmentation: A variogram-based method to determine appropriate scales for producing land-management information , 2010, Ecol. Informatics.

[3]  Jianyu Yang,et al.  Modified ALV for selecting the optimal spatial resolution and its scale effect on image classification accuracy , 2011, Math. Comput. Model..

[4]  José Carlos Príncipe,et al.  Mean shift: An information theoretic perspective , 2009, Pattern Recognit. Lett..

[5]  J. Six,et al.  Object-based crop identification using multiple vegetation indices, textural features and crop phenology , 2011 .

[6]  David W. S. Wong The Modifiable Areal Unit Problem (MAUP) , 2004 .

[7]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[8]  Shen Wei An Algorithm for Object-Oriented Multi-Scale Remote Sensing Image Segmentation , 2007 .

[9]  Clement Atzberger,et al.  Object Based Image Analysis and Data Mining applied to a remotely sensed Landsat time-series to map sugarcane over large areas , 2012 .

[10]  Brian Johnson,et al.  Unsupervised image segmentation evaluation and refinement using a multi-scale approach , 2011 .

[11]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Willem Bouten,et al.  Segmentation optimization and stratified object-based analysis for semi-automated geomorphological mapping , 2011 .

[13]  Thomas Blaschke,et al.  Image Segmentation Methods for Object-based Analysis and Classification , 2004 .

[14]  G. Tang,et al.  Optimal Scale Selection for DEM Based Slope Segmentation in the Loess Plateau , 2012 .

[15]  M. Rader,et al.  A computer model , 1996, IEEE Conference Record - Abstracts. 1996 IEEE International Conference on Plasma Science.

[16]  Thomas Blaschke,et al.  Optimization of scale and parametrization for terrain segmentation: An application to soil-landscape modeling , 2009, Comput. Geosci..

[17]  Jiri Matas,et al.  Robust scale-adaptive mean-shift for tracking , 2013, Pattern Recognit. Lett..

[18]  Jochen Einbeck,et al.  Bandwidth Selection for Mean-shift based Unsupervised Learning Techniques: a Unified Approach via Self-coverage , 2011 .

[19]  R. Pu,et al.  Remote sensing of seasonal variability of fractional vegetation cover and its object-based spatial pattern analysis over mountain areas , 2013 .

[20]  Xuelong Li,et al.  Mean shift based gradient vector flow for image segmentation , 2013, Comput. Vis. Image Underst..

[21]  Alan B. Anderson,et al.  Appropriate Plot Size and Spatial Resolution for Mapping Multiple Vegetation Types , 2001 .

[22]  Hu Zhan-Yi,et al.  Convergence of a Mean Shift Algorithm , 2005 .

[23]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Antônio Miguel Vieira Monteiro,et al.  Parameter selection for region‐growing image segmentation algorithms using spatial autocorrelation , 2006 .

[25]  Jan Sijbers,et al.  Multiscale watershed segmentation of multivalued images , 2002, Object recognition supported by user interaction for service robots.

[26]  Mustafa Ozden,et al.  A Nonparametric Adaptive Tracking Algorithm Based on Multiple Feature Distributions , 2006, IEEE Transactions on Multimedia.

[27]  Xianxing Liu,et al.  An adaptive mean shift clustering algorithm based on locality-sensitive hashing , 2012 .

[28]  Zongben Xu,et al.  Scale selection for anisotropic diffusion filter by Markov random field model , 2010, Pattern Recognit..

[29]  Dirk Tiede,et al.  ESP: a tool to estimate scale parameter for multiresolution image segmentation of remotely sensed data , 2010, Int. J. Geogr. Inf. Sci..

[30]  Dongping Ming,et al.  Semivariogram-Based Spatial Bandwidth Selection for Remote Sensing Image Segmentation With Mean-Shift Algorithm , 2012, IEEE Geoscience and Remote Sensing Letters.

[31]  Dorin Comaniciu,et al.  The Variable Bandwidth Mean Shift and Data-Driven Scale Selection , 2001, ICCV.

[32]  Kuo-Lung Wu,et al.  Mean shift-based clustering , 2007, Pattern Recognit..

[33]  Jiancheng Luo,et al.  Modified local variance based method for selecting the optimal spatial resolution of remote sensing image , 2010, 2010 18th International Conference on Geoinformatics.

[34]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[35]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Ying Liu,et al.  Landscape analysis of wetland plant functional types: The effects of image segmentation scale, vegetation classes and classification methods , 2012 .

[37]  Geoffrey J. Hay,et al.  Geographic Object-Based Image Analysis (GEOBIA): A new name for a new discipline , 2008 .

[38]  Peijun Li,et al.  Multispectral image segmentation by a multichannel watershed‐based approach , 2007 .

[39]  Dorin Comaniciu,et al.  An Algorithm for Data-Driven Bandwidth Selection , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Hoda M. Onsi,et al.  A proposed multi-scale approach with automatic scale selection for image change detection , 2010 .

[41]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[42]  G. Hay,et al.  An automated object-based approach for the multiscale image segmentation of forest scenes , 2005 .

[43]  Daming Shi,et al.  Segmentation of green vegetation of crop canopy images based on mean shift and Fisher linear discriminant , 2010, Pattern Recognit. Lett..

[44]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[45]  Jie Tian,et al.  Optimization in multi‐scale segmentation of high‐resolution satellite images for artificial feature recognition , 2007 .

[46]  Zhanyi Hu,et al.  A note on the convergence of the mean shift , 2007, Pattern Recognit..

[47]  Cláudio Rosito Jung,et al.  Combining wavelets and watersheds for robust multiscale image segmentation , 2007, Image Vis. Comput..

[48]  Patricia Gober,et al.  Per-pixel vs. object-based classification of urban land cover extraction using high spatial resolution imagery , 2011, Remote Sensing of Environment.

[49]  Timothy A. Warner,et al.  Estimation of optimal image object size for the segmentation of forest stands with multispectral IKONOS imagery , 2008 .

[50]  C. Woodcock,et al.  The factor of scale in remote sensing , 1987 .

[51]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[52]  G. Hay,et al.  Object-Based Image Analysis , 2008 .

[53]  Steven E. Franklin,et al.  A comparison of pixel-based and object-based image analysis with selected machine learning algorithms for the classification of agricultural landscapes using SPOT-5 HRG imagery , 2012 .

[54]  Jonghyun Park,et al.  Color image segmentation using adaptive mean shift and statistical model-based methods , 2009, Comput. Math. Appl..