Comprehensive measure for evaluating image fusion algorithm

Abstract. Evaluating the performance of image fusion algorithms objectively is still an open problem. We proposed an integrational approach to objective image fusion evaluation based on integrating different existing objective metrics in order to overcome their individual shortcomings. The process of the objective measure construction contains two steps: first, we construct a candidate measure set, where each element contains high evaluation accuracy and low correlation with each other; then, the weights of measures in constructing the target measure are determined dynamically on training image set. Considering that the true quality of fused images is a subjective perception, we introduce assessment indefiniteness when calculating the evaluation accuracy of each measure to reduce the influence of errors of subjective perception. Experiments on various images are conducted to test the effectiveness of the proposed measure. The results have shown that the measure is useful in conjunction with the other objective measures to account for qualitative subjective perception.

[1]  Zheng Liu,et al.  Objective Assessment of Multiresolution Image Fusion Algorithms for Context Enhancement in Night Vision: A Comparative Study , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  M. Hossny,et al.  Comments on 'Information measure for performance of image fusion' , 2008 .

[3]  Yufeng Zheng,et al.  Qualitative and quantitative comparisons of multispectral night vision colorization techniques , 2012, Optical Engineering.

[4]  Naoto Yokoya,et al.  Hyperspectral Pansharpening: A Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[5]  Xiongfei Li,et al.  The use of ROC and AUC in the validation of objective image fusion evaluation metrics , 2015, Signal Process..

[6]  Srinivasu Polinati,et al.  A Review on Multi-Model Medical Image Fusion , 2019, 2019 International Conference on Communication and Signal Processing (ICCSP).

[7]  Dapeng Tao,et al.  Joint medical image fusion, denoising and enhancement via discriminative low-rank sparse dictionaries learning , 2018, Pattern Recognit..

[8]  Mohammad Sadegh Helfroush,et al.  HS remote sensing image restoration using fusion with MS images by EM algorithm , 2017, IET Signal Process..

[9]  Timothy F. Cootes,et al.  Information Representation for Image Fusion Evaluation , 2006, 2006 9th International Conference on Information Fusion.

[10]  Rabab Kreidieh Ward,et al.  Deep learning for pixel-level image fusion: Recent advances and future prospects , 2018, Inf. Fusion.

[11]  Yu-Chiang Frank Wang,et al.  Exploring Visual and Motion Saliency for Automatic Video Object Extraction , 2013, IEEE Transactions on Image Processing.

[12]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Peng-wei Wang,et al.  A novel image fusion metric based on multi-scale analysis , 2008, 2008 9th International Conference on Signal Processing.

[14]  Lei Zhang,et al.  Robust Multi-Exposure Image Fusion: A Structural Patch Decomposition Approach , 2017, IEEE Transactions on Image Processing.

[15]  R. S. Anand,et al.  CT and MR image information fusion scheme using a cascaded framework in ripplet and NSST domain , 2018, IET Image Process..

[16]  Yu Liu,et al.  A general framework for image fusion based on multi-scale transform and sparse representation , 2015, Inf. Fusion.

[17]  Zhou Wang,et al.  Complex Wavelet Structural Similarity: A New Image Similarity Index , 2009, IEEE Transactions on Image Processing.

[18]  Naoto Yokoya,et al.  Hyperspectral and Multispectral Data Fusion: A comparative review of the recent literature , 2017, IEEE Geoscience and Remote Sensing Magazine.

[19]  P Sreeja,et al.  An improved feature based image fusion technique for enhancement of liver lesions , 2018 .

[20]  Johannes R. Sveinsson,et al.  Multispectral and Hyperspectral Image Fusion Using a 3-D-Convolutional Neural Network , 2017, IEEE Geoscience and Remote Sensing Letters.

[21]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[22]  Zhou Wang,et al.  Objective Quality Assessment for Multiexposure Multifocus Image Fusion , 2015, IEEE Transactions on Image Processing.

[23]  Yu Han,et al.  A new image fusion performance metric based on visual information fidelity , 2013, Inf. Fusion.

[24]  Yanning Zhang,et al.  High dynamic range imaging by sparse representation , 2017, Neurocomputing.

[25]  Zheng Liu,et al.  Statistical comparison of image fusion algorithms: Recommendations , 2017, Inf. Fusion.

[26]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[27]  Javier Marcello,et al.  Evaluation of Spatial and Spectral Effectiveness of Pixel-Level Fusion Techniques , 2013, IEEE Geoscience and Remote Sensing Letters.

[28]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[29]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[30]  Zheng Liu,et al.  PERFORMANCE ASSESSMENT OF COMBINATIVE PIXEL-LEVEL IMAGE FUSION BASED ON AN ABSOLUTE FEATURE MEASUREMENT , 2007 .

[31]  Zheng Liu,et al.  A feature-based metric for the quantitative evaluation of pixel-level image fusion , 2008, Comput. Vis. Image Underst..

[32]  Yufeng Zheng,et al.  A new metric based on extended spatial frequency and its application to DWT based fusion algorithms , 2007, Inf. Fusion.

[33]  Vladimir S. Petrovic,et al.  Subjective tests for image fusion evaluation and objective metric validation , 2007, Inf. Fusion.

[34]  Tom Troscianko,et al.  Selection of image fusion quality measures: objective, subjective, and metric assessment. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[35]  Zhengfang Duanmu,et al.  Multi-Exposure Image Fusion by Optimizing A Structural Similarity Index , 2018, IEEE Transactions on Computational Imaging.

[36]  Pramod K. Varshney,et al.  A human perception inspired quality metric for image fusion based on regional information , 2007, Inf. Fusion.

[37]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[38]  Henk J. A. M. Heijmans,et al.  A new quality metric for image fusion , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[39]  Xiuqing Wu,et al.  A novel similarity based quality metric for image fusion , 2008, 2008 International Conference on Audio, Language and Image Processing.

[40]  Yang Chen,et al.  Gradient-based compressive image fusion , 2015, Frontiers of Information Technology & Electronic Engineering.