Pansharpening multispectral remote‐sensing images with guided filter for monitoring impact of human behavior on environment

Human behavior would lead to a significant impact on the environment. By monitoring the environment, we can indirectly monitor human behavior. Remote sensing (RS) technology provides a large number of multispectral (MS) images. When combining the Internet of things (IoT) technology, those images can be used for human behavioral monitoring. However, due to the limitation of the optical sensors embedded in satellites, the spatial resolution of MS image is relatively low, which poses a huge problem for further understanding these images. Pansharpening, also known as multisensor image fusion, aims to sharp an MS image to a high‐resolution multisensor image (HMS) by integrating a corresponding high‐resolution panchromatic (PAN) image. By doing so, the redundancy among big data can be effectively reduced. Traditional Intensity‐Hue‐Saturation (IHS)–based methods often suffer from spectral distortion. To address this problem, a novel pansharpening method is proposed in this paper. Different from those traditional IHS methods, the proposed method first decomposes MS and PAN into high‐frequency‐component (HFC) and low‐frequency‐component (LFC), respectively. Then, the guided filter (GF) is utilized to enhance the spectral information on the detail map. Furthermore, the detail map is refined according to the adaptive coefficients for each band of MS. By performing experiments, we demonstrate the proposed method can obtain satisfying results in both visual quality and object assessment among existing methods.

[1]  Jocelyn Chanussot,et al.  Pansharpening Based on Deconvolution for Multiband Filter Estimation , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Roger L. King,et al.  An Efficient Pan-Sharpening Method via a Combined Adaptive PCA Approach and Contourlets , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Kiyun Yu,et al.  A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Isin Erer,et al.  Bilateral Filtering-Based Enhanced Pansharpening of Multispectral Satellite Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[5]  Michael Möller,et al.  An Adaptive IHS Pan-Sharpening Method , 2010, IEEE Geoscience and Remote Sensing Letters.

[6]  Guixu Zhang,et al.  A Pan-Sharpening Method Based on Evolutionary Optimization and IHS Transformation , 2017 .

[7]  Jonathan Krause,et al.  Using deep learning and Google Street View to estimate the demographic makeup of neighborhoods across the United States , 2017, Proceedings of the National Academy of Sciences.

[8]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[9]  Firouz Abdullah Al-Wassai,et al.  The IHS Transformations Based Image Fusion , 2011, ArXiv.

[10]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Wenzhong Shi,et al.  Remote Sensing Image Fusion Using Multiscale Mapped LS-SVM , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Mark J. Shensa,et al.  The discrete wavelet transform: wedding the a trous and Mallat algorithms , 1992, IEEE Trans. Signal Process..

[13]  Arun Kumar Sangaiah,et al.  Pansharpening using a guided image filter based on dual-scale detail extraction , 2018 .

[14]  Lucien Wald,et al.  Quality of high resolution synthesised images: Is there a simple criterion ? , 2000 .

[15]  Lorenzo Bruzzone,et al.  Image fusion techniques for remote sensing applications , 2002, Inf. Fusion.

[16]  P. Chavez,et al.  Extracting spectral contrast in landsat thematic mapper image data using selective principal component analysis , 1989 .

[17]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Jocelyn Chanussot,et al.  Indusion: Fusion of Multispectral and Panchromatic Images Using the Induction Scaling Technique , 2008, IEEE Geoscience and Remote Sensing Letters.

[19]  Abdellah Chehri,et al.  Image Enlargement Using Multiple Sensors , 2016, J. Sensors.

[20]  Pan Lin,et al.  A Novel Pan-Sharpening Framework Based on Matting Model and Multiscale Transform , 2017, Remote. Sens..

[21]  Myungjin Choi,et al.  A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter , 2006, IEEE Trans. Geosci. Remote. Sens..

[22]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[23]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[24]  Wei Lu,et al.  An Adaptive Pansharpening Method by Using Weighted Least Squares Filter , 2016, IEEE Geoscience and Remote Sensing Letters.

[25]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[26]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Shadrokh Samavi,et al.  Multi-focus image fusion using dictionary-based sparse representation , 2015, Inf. Fusion.

[28]  Davide Cozzolino,et al.  Target-Adaptive CNN-Based Pansharpening , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Jon Atli Benediktsson,et al.  Pansharpening Based on Intrinsic Image Decomposition , 2014 .

[30]  Chein-I. Chang Spectral information divergence for hyperspectral image analysis , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[31]  Liangpei Zhang,et al.  Review of the pansharpening methods for remote sensing images based on the idea of meta-analysis: Practical discussion and challenges , 2019, Inf. Fusion.

[32]  Kai Liu,et al.  Multi-scale image fusion through rolling guidance filter , 2018, Future Gener. Comput. Syst..

[33]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[34]  S. Baronti,et al.  Multispectral and panchromatic data fusion assessment without reference , 2008 .

[35]  B. Silverman,et al.  The Stationary Wavelet Transform and some Statistical Applications , 1995 .