Evaluation of panchromatic and multispectral image fusion methods using natural images

Images provided by various remote sensing satellites are multispectral, low resolution, and panchromatic, high resolution, which are fused, enlarging the low resolution images to make them the same size as the panchromatic ones. Panchromatic images have good spatial resolution but only one spectral band and multispectral images typically have four or eight bands but are four times lower in spatial resolution than a panchromatic image. Image fusion of this type seeks to combine the best feature of the high spatial panchromatic image with the low spatial multispectral image to obtain an image with high spatial and spectral resolution. Several techniques have been developed to perform this fusion however the techniques with low computational resource consumption are EIHS Algorithm, Brovey Algorithm, Averaging Algorithm. To compare them, in this work, natural color photographs are taken, from which high resolution monochromatic and lower resolution chromatic images are obtained to emulate the real situation. The low resolution color images obtained were interpolated using three satellite image interpolation techniques. The fusion techniques were evaluated, obtaining the quantitative spectral and spatial ERGAS indices and the RMSE. The EIHS and Brovey techniques were found to produce artifacts because the color component values can fall above or below the representation interval [0,255]. After correcting this issue, it was found that the EIHS and Brovey methods, in that order, produced the lowest RMSE, followed by the averaging method. Since this result proved to be inconsistent with that obtained with the mean ERGAS, a new normalized mean ERGAS that gives a better indication of fusion quality, matching the result given by the RMSE, was proposed to be used instead.

[1]  Qiankun Dong,et al.  Research of Image Fusion Method about ZY-3 Panchromatic Image and Multispectral Image , 2018, 2018 Fifth International Workshop on Earth Observation and Remote Sensing Applications (EORSA).

[2]  Francisco Eugenio,et al.  Object-based quality evaluation procedure for fused remote sensing imagery , 2017, Neurocomputing.

[3]  Xiaoyi Feng,et al.  Study on panchromatic and multispectral image fusion based on SFIM and CA transform , 2016, 2016 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC).

[4]  Jianping Fan,et al.  Panchromatic and multi-spectral image fusion for new satellites based on multi-channel deep model , 2018, Machine Vision and Applications.

[5]  Erika Upegui,et al.  Image fusion using the Wavelet TRW and Haar transforms: Enhancement of spatial resolution for the Ikonos images from Ortophotos , 2016, 2016 7th IEEE International Conference on Software Engineering and Service Science (ICSESS).

[6]  Shuyuan Yang,et al.  Fusion of Panchromatic and Multispectral Images via Coupled Sparse Non-Negative Matrix Factorization , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Jianhua Zhao,et al.  Evaluation on BJ-2 Image Fusion Algorithms for Satellite Images of Coastal Aquaculture Sea Areas , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[8]  Fusion Method Evaluation and Classification Suitability Study of Wetland Satellite Imagery , 2019, Earth Sciences Research Journal.

[9]  F. Wang,et al.  Optimization of Fusion Method for GF-2 Satellite Remote Sensing Images based on the Classification Effect , 2019, Earth Sciences Research Journal.