Incorporating an Adaptive Image Prior Model Into Bayesian Fusion of Multispectral and Panchromatic Images

Reconstruction of a sharpened multispectral (MS) image from its coarser measurements, namely the low spatial resolution MS and panchromatic (Pan) images, is a severely illposed inverse problem which requires the definition of an appropriate prior model. This letter incorporates an adaptive Markov random field (MRF)-based prior model into a Bayesian framework to recover the desired MS image. The proposed MRF-based prior model combines the high frequency details of the Pan image with the spectral relation between the bands of the MS image into a single energy function. Consequently, unlike most pansharpening methods, not directly injecting the spatial information of the Pan image into the fused product, the proposed method offers a fused product with minimum spectral distortion, along with perfectly enhanced spatial resolution. Visual and quantitative assessments of the fused products of the proposed method compared to those of some famous pansharpening methods prove the superiority of the proposed method.

[1]  Jie Li,et al.  Pansharpening with a Guided Filter Based on Three-Layer Decomposition , 2016, Sensors.

[2]  Hassan Ghassemian,et al.  Remote Sensing Image Fusion Using Ripplet Transform and Compressed Sensing , 2015, IEEE Geoscience and Remote Sensing Letters.

[3]  H. Ghassemian,et al.  A multi-objective component-substitution-based pansharpening , 2017, 2017 3rd International Conference on Pattern Recognition and Image Analysis (IPRIA).

[4]  Jocelyn Chanussot,et al.  A Pansharpening Method Based on the Sparse Representation of Injected Details , 2015, IEEE Geoscience and Remote Sensing Letters.

[5]  Kiyun Yu,et al.  A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Luciano Alparone,et al.  Intersensor Statistical Matching for Pansharpening: Theoretical Issues and Practical Solutions , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Liangpei Zhang,et al.  Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network , 2017, IEEE Geoscience and Remote Sensing Letters.

[8]  Liangpei Zhang,et al.  Adjustable Model-Based Fusion Method for Multispectral and Panchromatic Images , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Hassan Ghassemian,et al.  A Compressed-Sensing-Based Pan-Sharpening Method for Spectral Distortion Reduction , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Hongyi Liu,et al.  A New Pan-Sharpening Method With Deep Neural Networks , 2015, IEEE Geoscience and Remote Sensing Letters.

[12]  Mark J. Shensa,et al.  The discrete wavelet transform: wedding the a trous and Mallat algorithms , 1992, IEEE Trans. Signal Process..

[13]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Liangpei Zhang,et al.  An Integrated Framework for the Spatio–Temporal–Spectral Fusion of Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Hassan Ghassemian,et al.  A review of remote sensing image fusion methods , 2016, Inf. Fusion.

[16]  Davide Cozzolino,et al.  Pansharpening by Convolutional Neural Networks , 2016, Remote. Sens..

[17]  Manjunath V. Joshi,et al.  MAP Estimation for Multiresolution Fusion in Remotely Sensed Images Using an IGMRF Prior Model , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Junfeng Yang,et al.  PanNet: A Deep Network Architecture for Pan-Sharpening , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[19]  Johannes R. Sveinsson,et al.  A New Pansharpening Algorithm Based on Total Variation , 2014, IEEE Geoscience and Remote Sensing Letters.

[20]  Sabalan Daneshvar,et al.  MRI and PET image fusion by combining IHS and retina-inspired models , 2010, Inf. Fusion.

[21]  Hassan Ghassemian,et al.  Remote-sensing image fusion based on curvelets and ICA , 2015 .

[22]  Andrea Garzelli,et al.  Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Liangpei Zhang,et al.  Improving the spatial resolution of hyperspectral image using panchromatic and multispectral images: An integrated method , 2015, 2015 7th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).