Theoretical analysis of an information-based quality measure for image fusion

While recently a few image fusion quality measures have been proposed, analytical studies of these measures have been lacking. Here, we focus on one popular mutual information-based quality measure and weighted averaging image fusion. Based on an image formation model, we obtain a closed-form expression for the quality measure and mathematically analyze its properties under different types of image distortion. Tests with real images are also presented which agree with the conclusions of the analytical results. The results show the quality measure studied does not generally properly characterize increases in the distortion (noise and blurring) of the images which are input into a weighted averaging fusion algorithm.

[1]  Ravi K. Sharma,et al.  Bayesian sensor image fusion using local linear generative models , 2001 .

[2]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[3]  Yong Huang,et al.  Texture decomposition by harmonics extraction from higher order statistics , 2004, IEEE Trans. Image Process..

[4]  Jun Li.  SPATIAL QUALITY EVALUATION OF FUSION OF DIFFERENT RESOLUTION IMAGES , 2000 .

[5]  Ronald V. Kruk,et al.  Evaluation of algorithms for fusing infrared and synthetic imagery , 2000, Defense, Security, and Sensing.

[6]  Rick S. Blum,et al.  Concealed weapon detection using color image fusion , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[7]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[8]  Pramod K. Varshney.  Multisensor data fusion , 1997 .

[9]  Lorenzo Bruzzone,et al.  Image fusion techniques for remote sensing applications , 2002, Inf. Fusion.

[10]  Timo Rolf Bretschneider,et al.  Objective content-dependent quality measures for image fusion of optical data , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[11]  Rick S. Blum,et al.  On estimating the quality of noisy images , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[12]  Oliver Rockinger,et al.  Image sequence fusion using a shift-invariant wavelet transform , 1997, Proceedings of International Conference on Image Processing.

[13]  Carlo S. Regazzoni,et al.  Advanced Video-Based Surveillance Systems , 1998 .

[14]  Rick S. Blum.  Robust image fusion using a statistical signal processing approach , 2005, Inf. Fusion.

[15]  Vladimir S. Petrovic,et al.  Sensor noise effects on signal-level image fusion performance , 2003, Inf. Fusion.

[16]  R.S. Blum,et al.  Experimental tests of image fusion for night vision , 2005, 2005 7th International Conference on Information Fusion.

[17]  G. Piella.  New quality measures for image fusion , 2004 .

[18]  Rick S. Blum.  On multisensor image fusion performance limits from an estimation theory perspective , 2006, Inf. Fusion.

[19]  Allen M. Waxman,et al.  Color Night Vision: Opponent Processing in the Fusion of Visible and IR Imagery , 1997, Neural Networks.

[20]  Pramod K. Varshney,et al.  Registration and fusion of infrared and millimeter wave images for concealed weapon detection , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[21]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[22]  Henk J. A. M. Heijmans,et al.  A new quality metric for image fusion , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[23]  Rick S. Blum,et al.  Image Fusion Using the Expectation-Maximization Algorithm and a Gaussian Mixture Model , 2003 .

[24]  Rick S. Blum,et al.  A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application , 1999, Proc. IEEE.

[25]  Rick S. Blum,et al.  An Overview of Image Fusion , 2005 .

[26]  Alexander Toet,et al.  Perceptual evaluation of different image fusion schemes , 2003 .

[27]  Mario Aguilar,et al.  Fusion of multi-modality volumetric medical imagery , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[28]  Ravi K. Sharma,et al.  Probabilistic Image Sensor Fusion , 1998, NIPS.

[29]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[30]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[31]  Rick S. Blum,et al.  A statistical signal processing approach to image fusion for concealed weapon detection , 2002, Proceedings. International Conference on Image Processing.