A Framelet-Based SFIM Method to Pan-Sharpen THEOS Imagery

This paper proposes an improved framelet-based pan-sharpening algorithm for Thailand Earth Observation System (THEOS) imagery to decrease the effects of different acquisition times between panchromatic (Pan) and multispectral (MS) images, in which the smoothing filter-based intensity modulation (SFIM) is introduced into low-frequency information fusion instead of the conventional “mean” rule. Moreover, a two-layer procedure is presented to reduce the impacts of mixed pixels caused by the large difference of spatial resolutions between the Pan and MS images. The proposed method is tested on two THEOS datasets and compared with the Gram–Schmidt, SFIM and traditional framelet-based methods. The portability across contourlet transform is also examined. Both qualitative and quantitative evaluation results demonstrate that the proposed method is more independent of the illumination of the Pan image and can achieve better spectral fidelity while maintaining spatial sharpness.

[1]  Gwendoline Blanchet,et al.  A Survey of Pansharpening Methods with A New Band-Decoupled Variational Model , 2016, ArXiv.

[2]  Bo Wu,et al.  Enhanced hyperspherical color space fusion technique preserving spectral and spatial content , 2015 .

[3]  Dequan Zheng,et al.  Study on the Optimal Parameters of Image Fusion Based on Wavelet Transform , 2010 .

[4]  Mallika K.,et al.  Framelet Based Image Fusion for the Enhancement of Cloud Associated Shadow areas in Satellite Images , 2009, 2009 International Conference on Advances in Computing, Control, and Telecommunication Technologies.

[5]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation : a spectral preserve image fusion technique for improving spatial details , 2001 .

[6]  Tao Li,et al.  A Variational Pan-Sharpening Method Based on Spatial Fractional-Order Geometry and Spectral–Spatial Low-Rank Priors , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[7]  B. Han.  Properties of Discrete Framelet Transforms , 2013 .

[8]  Curtis E. Woodcock,et al.  Trends in Land Cover Mapping and Monitoring , 2012 .

[9]  Rafael García,et al.  Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Yun Zhang,et al.  Recent advances in pansharpening and key problems in applications , 2014 .

[11]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Roger L. King,et al.  An Efficient Pan-Sharpening Method via a Combined Adaptive PCA Approach and Contourlets , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Liangpei Zhang,et al.  Review of the pansharpening methods for remote sensing images based on the idea of meta-analysis: Practical discussion and challenges , 2019, Inf. Fusion.

[14]  Yun Zhang,et al.  Wavelet based image fusion techniques — An introduction, review and comparison , 2007 .

[15]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[16]  Gaurav Bhatnagar,et al.  An Image Fusion Framework Based on Human Visual System in Framelet Domain , 2012, Int. J. Wavelets Multiresolution Inf. Process..

[17]  Zhenpeng Zhao,et al.  Tensor Product Complex Tight Framelets with Increasing Directionality , 2013, SIAM J. Imaging Sci..

[18]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[19]  Ivan W. Selesnick,et al.  The double-density dual-tree DWT , 2004, IEEE Transactions on Signal Processing.

[20]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[21]  G. Prost,et al.  Remote sensing for geoscientists : image analysis and integration , 2013 .

[22]  Bin Han,et al.  Algorithm for constructing symmetric dual framelet filter banks , 2014, Math. Comput..

[24]  Luciano Alparone,et al.  A Theoretical Analysis of the Effects of Aliasing and Misregistration on Pansharpened Imagery , 2011, IEEE Journal of Selected Topics in Signal Processing.

[25]  Ivan W. Selesnick,et al.  Gröbner bases and wavelet design , 2004, J. Symb. Comput..

[26]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[27]  Davide Cozzolino,et al.  Pansharpening by Convolutional Neural Networks , 2016, Remote. Sens..

[29]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[30]  I. Selesnick,et al.  Symmetric wavelet tight frames with two generators , 2004 .

[31]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Liangpei Zhang,et al.  Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network , 2017, IEEE Geoscience and Remote Sensing Letters.

[33]  Jixian Zhang.  Multi-source remote sensing data fusion: status and trends , 2010 .

[34]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[35]  Shuyuan Yang,et al.  Pan-sharpening via deep metric learning , 2018 .