Parameter evaluation and optimization for multi-resolution segmentation in object-based shadow detection using very high resolution imagery

Abstract Object-based shadow detection in urban areas is an important topic in very high resolution remote sensing image processing. Multi-resolution segmentation (MRS) is an effective segmentation method, and is used for object-based shadow detection. However, several input parameters within MRS may result in unstable performance for final shadow detection; thus, the evaluation and optimization for the parameters upon the final shadow detection accuracy cannot be overlooked. In this paper, the three parameters in MRS (scale s, weight of colour wcolor and weight of compactness wcompact) upon the final result of a recently proposed method, object-based shadow detection with Dempster–Shafer theory, were evaluated and optimized by sensitivity analysis and Taguchi’s method with three experimental data. Experiments show that scale s is the most sensitive parameter among the three parameters within MRS. More importantly, according to the Taguchi’s method theory, there is a very significant interaction effect between s and wcolor, which cannot be overlooked. The shadow detection accuracy yielded by the optimum parameter combination in consideration of the interaction effect is higher than that only optimized by covering the main effect of single parameter in most cases.

[1]  X. Briottet,et al.  Shadow detection in very high spatial resolution aerial images: A comparative study , 2013 .

[2]  J. Strobl,et al.  Object-Oriented Image Processing in an Integrated GIS/Remote Sensing Environment and Perspectives for Environmental Applications , 2000 .

[3]  P. Dare Shadow Analysis in High-Resolution Satellite Imagery of Urban Areas , 2005 .

[4]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[5]  Liang Tang,et al.  Detection of and compensation for shadows in colored urban aerial images , 2004, Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788).

[6]  P. Shi,et al.  Shadow information recovery in urban areas from very high resolution satellite imagery , 2007 .

[7]  Javier Gonzalez,et al.  Shadow detection in colour high‐resolution satellite images , 2008 .

[8]  Pooya Sarabandi,et al.  Shadow detection and radiometric restoration in satellite high resolution images , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[9]  J. Kovacs,et al.  An object-oriented classification method for mapping mangroves in Guinea, West Africa, using multipolarized ALOS PALSAR L-band data , 2013 .

[10]  Liangpei Zhang,et al.  An Adaptive Mean-Shift Analysis Approach for Object Extraction and Classification From Urban Hyperspectral Imagery , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Deren Li,et al.  Shadow detection for color remotely sensed images based on multi-feature integration , 2012 .

[12]  Kuo-Liang Chung,et al.  Efficient Shadow Detection of Color Aerial Images Based on Successive Thresholding Scheme , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Hao Wu,et al.  An object-based image analysis for building seismic vulnerability assessment using high-resolution remote sensing imagery , 2014, Natural Hazards.

[14]  Yan Li,et al.  A SYSTEM OF THE SHADOW DETECTION AND SHADOW REMOVAL FOR HIGH RESOLUTION CITY AERIAL PHOTO , 2004 .

[15]  Liangpei Zhang,et al.  Three-Dimensional Wavelet Texture Feature Extraction and Classification for Multi/Hyperspectral Imagery , 2014, IEEE Geoscience and Remote Sensing Letters.

[16]  K. Moffett,et al.  Distinguishing wetland vegetation and channel features with object-based image segmentation , 2013 .

[17]  Laurel Richardson,et al.  The Writing Group , 2018 .

[18]  Zhenfeng Shao,et al.  BASI: a new index to extract built-up areas from high-resolution remote sensing images by visual attention model , 2014 .

[19]  Stefano Soatto,et al.  Quick Shift and Kernel Methods for Mode Seeking , 2008, ECCV.

[20]  ZHU Qing,et al.  A New Shadow Extraction Method from Color Aerial Images Based on Dempster-Shafer Evidence Theory , 2007 .

[21]  Chong Liu,et al.  The Integrated Use of DMSP-OLS Nighttime Light and MODIS Data for Monitoring Large-Scale Impervious Surface Dynamics: A Case Study in the Yangtze River Delta , 2014, Remote. Sens..

[22]  Bui Tuong Phong Illumination for computer generated pictures , 1975, Commun. ACM.

[23]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Victor J. D. Tsai,et al.  A comparative study on shadow compensation of color aerial images in invariant color models , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Peng Gong,et al.  Integrated shadow removal based on photogrammetry and image analysis , 2005 .

[26]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[27]  Patrick M. Reed,et al.  Technical Note: Method of Morris effectively reduces the computational demands of global sensitivity analysis for distributed watershed models , 2013 .

[28]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[29]  Austin Troy,et al.  Object-based land cover classification of shaded areas in high spatial resolution imagery of urban areas: A comparison study , 2009 .

[30]  Ming-Chih Huang,et al.  The effective factors in the warpage problem of an injection-molded part with a thin shell feature , 2001 .

[31]  Yun Zhang,et al.  A Supervised and Fuzzy-based Approach to Determine Optimal Multi-resolution Image Segmentation Parameters , 2012 .

[32]  R. Roy A Primer on the Taguchi Method , 1990 .

[33]  Laurent Durieux,et al.  A method for monitoring building construction in urban sprawl areas using object-based analysis of Spot 5 images and existing GIS data , 2008 .

[34]  Wen Liu,et al.  Shadow extraction and correction from quickbird images , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[35]  Xiaoyi Jiang,et al.  Orthogonal design of experiments for parameter learning in image segmentation , 2013, Signal Process..

[36]  Christopher S. Galletti,et al.  Object vs. pixel: a systematic evaluation in urban environments , 2013 .

[37]  Deren Li,et al.  Development of a multi-scale object-based shadow detection method for high spatial resolution image , 2015 .

[38]  Krištof Oštir,et al.  Investigating the impact of spatial and spectral resolution of satellite images on segmentation quality , 2014 .

[39]  Bo Du,et al.  Slow Feature Analysis for Change Detection in Multispectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Dirk Tiede,et al.  ESP: a tool to estimate scale parameter for multiresolution image segmentation of remotely sensed data , 2010, Int. J. Geogr. Inf. Sci..

[41]  Liangpei Zhang,et al.  An Adaptive Nonlocal Regularized Shadow Removal Method for Aerial Remote Sensing Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[42]  田口 玄一,et al.  Introduction to quality engineering : designing quality into products and processes , 1986 .

[43]  Yan Gao,et al.  Optimal region growing segmentation and its effect on classification accuracy , 2011 .

[44]  Jing Li,et al.  Hierarchical object oriented classification using very high resolution imagery and LIDAR data over urban areas , 2009 .

[45]  Fan Xia,et al.  Assessing object-based classification: advantages and limitations , 2009 .

[46]  Patricia A. Bilby The Writing Group , 1984 .

[47]  Yoshifumi Yasuoka,et al.  Simulated recovery of information in shadow areas on IKONOS image by combing ALS data , 2002 .

[48]  Farid Melgani,et al.  A Complete Processing Chain for Shadow Detection and Reconstruction in VHR Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[49]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[50]  M. Beynon,et al.  The Dempster-Shafer theory of evidence: an alternative approach to multicriteria decision modelling , 2000 .