Multi-exposure image fusion quality assessment using contrast information

In this paper, a novel image quality assessment (IQA) metric for the multi-exposure image fusion (MEF) is proposed by using contrast information. Specifically, the proposed approach firstly performs the measurements of contrast structure similarity and contrast saturation similarity based on the observation that human perception is sensitive to contrast information inherited in the MEF and reference images. Then, considering that different reference images contribute differently to the MEF image, the weights are adaptively assigned to each reference image according to its relevance to the MEF image. A standard deviation based pooling strategy and multi-scale scheme are subsequently used to generate the final MEF image quality score. Experimental results have shown that the proposed metric produces high consistency with human perception of the MEF image quality and outperforms the state-of-the-art quality metric.

[1]  Jan Kautz,et al.  Exposure Fusion , 2009, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[2]  Bo Gu,et al.  Gradient field multi-exposure images fusion for high dynamic range image visualization , 2012, J. Vis. Commun. Image Represent..

[3]  Kai Zeng,et al.  Perceptual Quality Assessment for Multi-Exposure Image Fusion , 2015, IEEE Transactions on Image Processing.

[4]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[5]  Peng-wei Wang,et al.  A novel image fusion metric based on multi-scale analysis , 2008, 2008 9th International Conference on Signal Processing.

[6]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[7]  Rick S. Blum,et al.  A new automated quality assessment algorithm for image fusion , 2009, Image Vis. Comput..

[8]  Rick S. Blum,et al.  An Overview of Image Fusion , 2005 .

[9]  Anne H. Schistad Solberg,et al.  Information fusion in remote sensing , 1997 .

[10]  Henk J. A. M. Heijmans,et al.  A new quality metric for image fusion , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[11]  Ren C. Luo,et al.  Multisensor Fusion and Integration: A Review on Approaches and Its Applications in Mechatronics , 2012, IEEE Transactions on Industrial Informatics.

[12]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[13]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[14]  Susanto Rahardja,et al.  Detail-Enhanced Exposure Fusion , 2012, IEEE Transactions on Image Processing.

[15]  E. Micheli-Tzanakou,et al.  Medical imaging fusion applications: An overview , 2001, Conference Record of Thirty-Fifth Asilomar Conference on Signals, Systems and Computers (Cat.No.01CH37256).

[16]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.