Object-oriented detection of building shadow in TripleSat-2 remote sensing imagery

Abstract. The projection of objects on the earth’s surface caused by the sunlight produces shadows. They are inevitable in high-spatial-resolution satellite remote sensing images and reduce the accuracy of change detection, land cover classification, target recognition, and many more applications. Dark-colored land covers in these satellite images, such as water bodies, road, and soil, appear with similar spectral properties as those of shadows and often result in difficulty in shadow detection, especially in complex urban settings. We propose an object-oriented building shadow extraction method and tested it using six selected study areas from TripleSat-2 satellite imagery with 3.2-m spatial resolution. The method’s main steps include (1) selecting six image features that can highlight the shadow information and then segment the image based on edge; (2) extracting shadow region based on multiple object features; and (3) masking nonbuilding shadow regions by the shadow and dark object separation index, image features including spectral, textural, and geometric features, and contextual information. The average precision, recall, and F1-score of the shadow detection were 85.6%, 88.6%, and 87.0%, respectively, and the ranges were 73.0% to 91.0%, 76.6% to 94.1%, and 74.7% to 91.2%, respectively. Compared with multiscale segmentation, edge-based segmentation is more efficient and helpful to completely and accurately extract shadows.

[1]  Martin D. Levine,et al.  Removing shadows , 2005, Pattern Recognit. Lett..

[2]  Liang Tang,et al.  Detection of and compensation for shadows in colored urban aerial images , 2004, Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788).

[3]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[4]  YANG LiaoBAI Jie Pu Zhi.  Shadow Detection and Removal Based on Object-oriented Method inHigh Spatial Resolution Remote Sense Image , 2011 .

[5]  Victor J. D. Tsai,et al.  A comparative study on shadow compensation of color aerial images in invariant color models , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Touradj Ebrahimi,et al.  Cast shadow segmentation using invariant color features , 2004, Comput. Vis. Image Underst..

[7]  Tai-Pang Wu,et al.  A Bayesian approach for shadow extraction from a single image , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[8]  S. K. McFeeters.  The use of the Normalized Difference Water Index (NDWI) in the delineation of open water features , 1996 .

[9]  Marvin E. Bauer,et al.  MAPPING IMPERVIOUS SURFACE AREA USING HIGH RESOLUTION IMAGERY: A COMPARISON OF OBJECT-BASED AND PER PIXEL CLASSIFICATION , 2006 .

[10]  A. Gitelson,et al.  Novel algorithms for remote estimation of vegetation fraction , 2002 .

[11]  Deren Li,et al.  Shadow Detection in Remotely Sensed Images Based on Self-Adaptive Feature Selection , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Dirk Tiede,et al.  ESP: a tool to estimate scale parameter for multiresolution image segmentation of remotely sensed data , 2010, Int. J. Geogr. Inf. Sci..

[13]  Zhiguo Jiang,et al.  Shadow detection in remote sensing images based on weighted edge gradient ratio , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[14]  Alvy Ray Smith,et al.  Color gamut transform pairs , 1978, SIGGRAPH.

[15]  P. Dare.  Shadow Analysis in High-Resolution Satellite Imagery of Urban Areas , 2005 .

[16]  P. Shi,et al.  Shadow information recovery in urban areas from very high resolution satellite imagery , 2007 .

[17]  Dario F. G. de Azevedo,et al.  Near real-time shadow detection and removal in aerial motion imagery application , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[18]  Wen Liu,et al.  Characteristics of shadow and removal of its effects for remote sensing imagery , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[19]  Deren Li,et al.  Development of a multi-scale object-based shadow detection method for high spatial resolution image , 2015 .

[20]  Michal Shimoni,et al.  A shadow detection method for remote sensing images using VHR hyperspectral and LIDAR data , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[21]  Zhang Lin,et al.  A Shadow Detection Algorithm Based on Statistical and Edge Properties , 2009 .

[22]  Franklin César Flores,et al.  Automatic shadow segmentation in aerial color images , 2003, 16th Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI 2003).

[23]  Zhang Zhi-sheng,et al.  Shadow detection based on texture features in gray sequence images , 2013 .

[24]  Jonathan D. Jordan,et al.  A Comparison of Fuzzy vs. Augmented-ISODATA Classification Algorithms for Cloud-Shadow Discrimination from Landsat Images , 2002 .

[25]  Qiming Qin,et al.  Shadow Segmentation and Compensation in High Resolution Satellite Images , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[26]  Wenzhuo Li,et al.  Object-Oriented Shadow Detection and Removal From Urban High-Resolution Remote Sensing Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[27]  R. Bruce Irvin,et al.  Methods for exploiting the relationship between buildings and their shadows in aerial imagery , 1989, IEEE Trans. Syst. Man Cybern..

[28]  Yuan Xiu-xiao.  A Method for Shadow Detection and Change Detection of Man-made Objects , 2007 .

[29]  Taejung Kim,et al.  Semiautomatic reconstruction of building height and footprints from single satellite images , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[30]  Zhi-Gang Wang,et al.  Some Properties of Certain Class of Integral Operators , 2011 .

[31]  Lalit Kumar,et al.  Diffuse Skylight as a Surrogate for Shadow Detection in High-Resolution Imagery Acquired Under Clear Sky Conditions , 2018, Remote. Sens..

[32]  Jing Li,et al.  Hierarchical object oriented classification using very high resolution imagery and LIDAR data over urban areas , 2009 .

[33]  Muhammad Sarfraz,et al.  A Comparative Study on Shadow Detection Methods Based on Features , 2018, 2018 International Conference on Computing Sciences and Engineering (ICCSE).

[34]  Xu Qing,et al.  Shadow Extraction of Building Based on Multiple Constraints , 2005 .

[35]  Guo Ping.  A shadow detection of remote sensing images based on statistical texture features , 2011 .

[36]  X. Briottet,et al.  Shadow detection in very high spatial resolution aerial images: A comparative study , 2013 .

[37]  Wei Zhang,et al.  Moving cast shadows detection based on ratio edge , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[38]  Antonio J. Plaza,et al.  Efficient implementation of morphological index for building/shadow extraction from remotely sensed images , 2016, The Journal of Supercomputing.

[39]  Zhangquan Shen,et al.  Review of shadow detection and de-shadowing methods in remote sensing , 2013, Chinese Geographical Science.

[40]  Javier Gonzalez,et al.  Shadow detection in colour high‐resolution satellite images , 2008 .

[41]  Aihua Li,et al.  Adaptive shadow detection using global texture and sampling deduction , 2013, IET Comput. Vis..

[42]  Wan Xiao-dong.  Shadow Detection Algorithm Based on Edge Information and Illumination Direction , 2009 .

[43]  Kuo-Liang Chung,et al.  Efficient Shadow Detection of Color Aerial Images Based on Successive Thresholding Scheme , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Ahmed Abdelhafiz,et al.  Accurate Shadow Detection From High-Resolution Satellite Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[45]  Hong Guo.  Physical true random number generator , 2009, CSB 2009.

[46]  Li Yan,et al.  Deshadowing of Urban Airborne Imagery Based on Object-Oriented Automatic Shadow Detection and Regional Matching Compensation , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[47]  Jie Li,et al.  Shadow Detection in High-Resolution Remote Sensing Image Based on Improved K-means , 2016, ICIMCS.

[48]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Bodhaswar T. Maharaj,et al.  Adaptive Threshold-Based Shadow Masking for Across-Date Settlement Classification of Panchromatic QuickBird Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[50]  戎兵,et al.  ERDAS IMAGINE——遥感业界的先驱 , 1996 .

[51]  Cheng Lu,et al.  On the removal of shadows from images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Wei Wei,et al.  Study on shadow detection method on high resolution remote sensing image based on HIS space transformation and NDVI index , 2010, 2010 18th International Conference on Geoinformatics.

[53]  J. A. Schell,et al.  Monitoring vegetation systems in the great plains with ERTS , 1973 .

[54]  Peng Gong,et al.  Integrated shadow removal based on photogrammetry and image analysis , 2005 .

[55]  Austin Troy,et al.  Object-based land cover classification of shaded areas in high spatial resolution imagery of urban areas: A comparison study , 2009 .

[56]  Wang Xiaoqin,et al.  Building Extraction and Its Height Estimation over Urban Areas based on Morphological Building Index , 2015 .

[57]  Liangpei Zhang,et al.  Morphological Building/Shadow Index for Building Extraction From High-Resolution Imagery Over Urban Areas , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[58]  Alexei A. Efros,et al.  Detecting Ground Shadows in Outdoor Consumer Photographs , 2010, ECCV.