A Nonreference Image Fusion Metric Based on the Regional Importance Measure

In this paper, we present a novel metric for evaluation of image fusion algorithms, based on evaluation of similarity of regions in images to be fused with the corresponding regions in the fused image. The metric uses several factors to quantify the importance of regions in each of the input images, such as contrast, size, and shape of region. The similarity of the corresponding regions in an input image and the fused image is measured using a wavelet-based mutual information measure. Experimental results show that the proposed metric's ranking of different image fusion methods is more consistent with the subjective quality of the fused image than the state-of-the-art image fusion metrics.

[1]  Oliver Rockinger,et al.  Image sequence fusion using a shift-invariant wavelet transform , 1997, Proceedings of International Conference on Image Processing.

[2]  Wa James Tam,et al.  Static and dynamic spatial resolution in image coding: an investigation of eye movements , 1991, Electronic Imaging.

[3]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[4]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[5]  Vladimir Petrovic,et al.  Objective evaluation of signal-level image fusion performance , 2005 .

[6]  J. Findlay.  The Visual Stimulus for Saccadic Eye Movements in Human Observers , 1980, Perception.

[7]  Timothy F. Cootes,et al.  Objectively adaptive image fusion , 2007, Inf. Fusion.

[8]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[9]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[10]  Anthony J. Maeder,et al.  Automatic identification of perceptually important regions in an image , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[11]  Jan Noyes,et al.  Psychophysical and metric assessment of fused images , 2005, APGV '05.

[12]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[13]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[14]  Alexander Toet,et al.  Perceptual evaluation of different image fusion schemes , 2003 .

[15]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[16]  D. M. Ryan,et al.  Night pilotage assessment of image fusion , 1995, Defense, Security, and Sensing.

[17]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[18]  Cedric Nishan Canagarajah,et al.  Region-Based Multimodal Image Fusion Using ICA Bases , 2007, IEEE Sensors Journal.

[19]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[20]  N. Canagarajah,et al.  Wavelets for Image Fusion , 2001 .

[21]  David R. Bull,et al.  Combined morphological-spectral unsupervised image segmentation , 2005, IEEE Transactions on Image Processing.

[22]  Jan Noyes,et al.  Methods for the assessment of fused images , 2006, TAP.

[23]  Rick S. Blum,et al.  A new automated quality assessment algorithm for image fusion , 2009, Image Vis. Comput..

[24]  Christophe De Vleeschouwer,et al.  Automatic detection of interest areas of an image or of a sequence of images , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[25]  Pramod K. Varshney,et al.  A perceptual quality metric for image fusion based on regional information , 2005, SPIE Defense + Commercial Sensing.

[26]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[27]  David Bull,et al.  Image fusion metric based on mutual information and Tsallis entropy , 2006 .

[28]  Henk J. A. M. Heijmans,et al.  A new quality metric for image fusion , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[29]  Alastair G. Gale,et al.  Human Response to Visual Stimuli , 1993 .