Shadow detection using object area-based and morphological filtering for very high-resolution satellite imagery of urban areas

Abstract. The presence of shadows in remote sensing images leads to misinterpretation of objects and a wrong discrimination of the targets of interest, therefore, limiting the use of several imaging applications. An automatic area-based approach for shadow detection is proposed, which combines spatial and spectral features into a unified and flexible approach. Potential shadow-pixels candidates are identified using morphological-based operators, in particular, black-top-hat transformations as well as area injunction strategies as computed by the well-established normalized saturation-value difference index. The obtained output is a shadow mask, refined in the last step of our method in order to reduce misclassified pixels. Experiments over a large dataset formed by more than 200 scenes of very high-resolution images covering the metropolitan urban area of São Paulo city are performed, where the images are collected from the WorldView-2 (WV-2) and Pléiades-1B (PL-1B) sensors. As verified by an extensive battery of tests, the proposed method provides a good level of discrimination between shadow and nonshadow pixels, with an overall accuracy up to 94.2%, for WV-2, and 90.84%, for PL-1B. Comparative results also attested that the designed approach is very competitive against representative state-of-the-art methods and it can be used for further shadow removal-dependent applications.

[1]  Eija Honkavaara,et al.  Generating a hyperspectral digital surface model using a hyperspectral 2D frame camera , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[2]  Jiandong Tian,et al.  New spectrum ratio properties and features for shadow detection , 2016, Pattern Recognit..

[3]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[4]  Luciano Alparone,et al.  Quality assessment of pansharpening methods and products , 2011 .

[5]  P. Dare Shadow Analysis in High-Resolution Satellite Imagery of Urban Areas , 2005 .

[6]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[7]  Pedro Pina,et al.  Land cover classification using high‐resolution aerial photography in adventdalen, svalbard , 2015 .

[8]  C. Tucker Red and photographic infrared linear combinations for monitoring vegetation , 1979 .

[9]  P. Shi,et al.  Shadow information recovery in urban areas from very high resolution satellite imagery , 2007 .

[10]  Dario F. G. de Azevedo,et al.  Near real-time shadow detection and removal in aerial motion imagery application , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[11]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[12]  Jon Atli Benediktsson,et al.  Morphological Attribute Profiles for the Analysis of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Ben Gorte,et al.  Automatic Shadow Detection in Urban Very-High-Resolution Images Using Existing 3D Models for Free Training , 2019, Remote. Sens..

[14]  Thomas Maurer HOW TO PAN-SHARPEN IMAGES USING THE GRAM-SCHMIDT PAN-SHARPEN METHOD – A RECIPE , 2013 .

[15]  Li Yan,et al.  An Automatic Shadow Detection Method for VHR Remote Sensing Orthoimagery , 2017, Remote. Sens..

[16]  Fabio Crosilla,et al.  Shadow detection and removal in RGB VHR images for land use unsupervised classification , 2016 .

[17]  M. M. Pedrosa,et al.  SHADOW DETECTION IMPROVEMENT USING SPECTRAL INDICES AND MORPHOLOGICAL OPERATORS IN URBAN AREAS IN HIGH RESOLUTION IMAGES , 2015 .

[18]  Bo Huang,et al.  Urban land-use mapping using a deep convolutional neural network with high spatial resolution multispectral remote sensing imagery , 2018, Remote Sensing of Environment.

[19]  M. M. Pedrosa,et al.  Shadow detection improvement using spectral indices and morphological operators in high resolution images from urban areas , 2015 .

[20]  Aviva Peeters,et al.  A GIS-based method for modeling urban-climate parameters using automated recognition of shadows cast by buildings , 2016, Comput. Environ. Urban Syst..

[21]  Farid Melgani,et al.  A Complete Processing Chain for Shadow Detection and Reconstruction in VHR Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Wen Liu,et al.  Characteristics of shadow and removal of its effects for remote sensing imagery , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[23]  Michal Shimoni,et al.  A shadow detection method for remote sensing images using VHR hyperspectral and LIDAR data , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[24]  X. Briottet,et al.  Shadow detection in very high spatial resolution aerial images: A comparative study , 2013 .

[25]  Rogério Galante Negri,et al.  Inducing Contextual Classifications With Kernel Functions Into Support Vector Machines , 2018, IEEE Geoscience and Remote Sensing Letters.

[26]  Javier Gonzalez,et al.  Shadow detection in colour high‐resolution satellite images , 2008 .

[27]  L. Bruzzone,et al.  Modeling structural information for building extraction with morphological attribute filters , 2009, Remote Sensing.

[28]  Altan Mesut,et al.  A comparative analysis of image fusion methods , 2012, 2012 20th Signal Processing and Communications Applications Conference (SIU).

[29]  Pierre Soille,et al.  Morphological Image Analysis , 1999 .

[30]  Wei Huang,et al.  Detecting shadows in high-resolution remote-sensing images of urban areas using spectral and spatial features , 2015 .

[31]  Bo Huang,et al.  Shadow Detection and Reconstruction in High-Resolution Satellite Images via Morphological Filtering and Example-Based Learning , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Kuo-Liang Chung,et al.  Efficient Shadow Detection of Color Aerial Images Based on Successive Thresholding Scheme , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Victor J. D. Tsai,et al.  A comparative study on shadow compensation of color aerial images in invariant color models , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Josaphat Tetuko Sri Sumantyo,et al.  Assessment of pan-sharpening methods applied to image fusion of remotely sensed multi-band data , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[36]  Thomas B. Moeslund,et al.  Chromatic shadow detection and tracking for moving foreground segmentation , 2015, Image Vis. Comput..

[37]  Franklin César Flores,et al.  Automatic shadow segmentation in aerial color images , 2003, 16th Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI 2003).

[38]  Qiming Qin,et al.  Shadow Segmentation and Compensation in High Resolution Satellite Images , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[39]  Thiago Statella,et al.  SHADOWS AND CLOUDS DETECTION IN HIGH RESOLUTION IMAGES USING MATHEMATICAL MORPHOLOGY , 2008 .

[40]  Alfred Stein,et al.  Region-based urban road extraction from VHR satellite images using Binary Partition Tree , 2016, Int. J. Appl. Earth Obs. Geoinformation.