Towards the Spectral Restoration of Shadowed Areas in Hyperspectral Images Based on Nonlinear Unmixing

This work proposes a new shadow restoration method for hyperspectral images based on nonlinear unmixing. A physical model is introduced to estimate the shadowed spectrum from a spectrum of the same material exposed to direct sunlight. By defining pure spectra receiving direct and indirect illumination as sunlit and shadowed endmembers, respectively, the proposed method estimates the abundance maps for both sunlit and shadowed endmembers pixelwise, taking into account nonlinear effects up to the second order, which are of particular importance in shadow areas. Subsequently, the spectrum of a pixel in a scene is restored by a linear combination of sunlit and shadowed endmembers. Experimental results show that shadowed spectra can be successfully recovered and their true reflectance better estimated. In addition, the proposed method solves shadow detection and restoration simultaneously, so that it does not need a shadows mask as an additional input.

[1]  Alfred O. Hero,et al.  Nonlinear Unmixing of Hyperspectral Images: Models and Algorithms , 2013, IEEE Signal Processing Magazine.

[2]  Jean-Yves Tourneret,et al.  Supervised Nonlinear Spectral Unmixing Using a Postnonlinear Mixing Model for Hyperspectral Imagery , 2012, IEEE Transactions on Image Processing.

[3]  Wen Liu,et al.  Characteristics of shadow and removal of its effects for remote sensing imagery , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[4]  John R. Schott,et al.  Remote Sensing: The Image Chain Approach , 1996 .

[5]  P. Chavez An improved dark-object subtraction technique for atmospheric scattering correction of multispectral data , 1988 .

[6]  Lalit Kumar,et al.  Diffuse Skylight as a Surrogate for Shadow Detection in High-Resolution Imagery Acquired Under Clear Sky Conditions , 2018, Remote. Sens..

[7]  Fatih Omruuzun,et al.  Shadow removal from VNIR hyperspectral remote sensing imagery with endmember signature analysis , 2015, Commercial + Scientific Sensing and Imaging.

[8]  Paul D. Gader,et al.  A Review of Nonlinear Hyperspectral Unmixing Methods , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Guillaume Roussel,et al.  A sun/shadow approach for the classification of hyperspectral data , 2016, 2016 8th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[10]  Moussa Sofiane Karoui,et al.  A New Unmixing-Based Approach for Shadow Correction of Hyperspectral Remote Sensing Data , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[11]  Robert A. Leathers,et al.  A novel method for illumination suppression in hyperspectral images , 2008, SPIE Defense + Commercial Sensing.

[12]  Qiang Zhang,et al.  Detecting objects under shadows by fusion of hyperspectral and LiDAR DATA: A physical model approach , 2013, 2013 5th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[13]  Jörgen Ahlberg,et al.  Illumination and shadow compensation of hyperspectral images using a digital surface model and non-linear least squares estimation , 2011, Remote Sensing.

[14]  Antonio J. Plaza,et al.  Hyperspectral cloud shadow removal based on linear unmixing , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[15]  Vera Andrejchenko,et al.  Nonlinear Hyperspectral Unmixing With Graphical Models , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[16]  José M. Bioucas-Dias,et al.  Nonlinear mixture model for hyperspectral unmixing , 2009, Remote Sensing.

[17]  Yannick Deville,et al.  An Overview of Blind Source Separation Methods for Linear-Quadratic and Post-nonlinear Mixtures , 2015, LVA/ICA.