Fusion of color and infrared images using gradient transfer and total variation minimization

The objective of this paper is to propose an algorithm for fusion of images of two different image modalities, i.e., color visual image and its corresponding infrared (IR) image. Fusion method is based on l1 total variation minimization technique, and it combines appearance detail and thermal information for a scene using visual and IR images, respectively. Moreover, the proposed method maintains the natural color of the visual image in the fused image. Normally, IR image highlights the camouflage or hidden target in a scene due to its thermal variations from other objects. Therefore, the fused image is more detailed single image than its constituent images, and it reveals the concealed information which is not visible in input images. Experimental results show the effectiveness of the algorithm.

[1]  P. Huang,et al.  Efficient intensity-hue-saturation-based image fusion with saturation compensation , 2001 .

[2]  Hari Om,et al.  Medical Image Fusion Based on Wavelet Transform , 2014 .

[3]  Seong G. Kong,et al.  Multiscale Fusion of Visible and Thermal IR Images for Illumination-Invariant Face Recognition , 2007, International Journal of Computer Vision.

[4]  Rick S. Blum,et al.  Concealed weapon detection using color image fusion , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[5]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[6]  Qiang Zhang,et al.  Multifocus image fusion using the nonsubsampled contourlet transform , 2009, Signal Process..

[7]  Jong Beom Ra,et al.  Pseudo-color image fusion based on intensity-hue-saturation color space , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[8]  Alexander Toet,et al.  Fusion of visible and thermal imagery improves situational awareness , 1997 .

[9]  Zengchang Qin,et al.  Multifocus image fusion based on robust principal component analysis , 2013, Pattern Recognit. Lett..

[10]  Gang Liu,et al.  Color fusion based on EM algorithm for IR and visible image , 2010, 2010 The 2nd International Conference on Computer and Automation Engineering (ICCAE).

[11]  M. Tech Student,et al.  Study of Different Image fusion Algorithm , 2013 .

[12]  Y. Kiran Kumar,et al.  COMPARISON OF FUSION TECHNIQUES APPLIED TO PRECLINICAL IMAGES: FAST DISCRETE CURVELET TRANSFORM USING WRAPPING TECHNIQUE & WAVELET TRANSFORM , 2009 .

[13]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[14]  Jiayi Ma,et al.  Infrared and visible image fusion via gradient transfer and total variation minimization , 2016, Inf. Fusion.

[15]  S. S. Bedi,et al.  Comprehensive and Comparative Study of Image Fusion Techniques , 2013 .

[16]  Tony F. Chan,et al.  Aspects of Total Variation Regularized L[sup 1] Function Approximation , 2005, SIAM J. Appl. Math..

[17]  J. Yang,et al.  A SPATIAL DOMAIN AND FREQUENCY DOMAIN INTEGRATED APPROACH TO FUSION MULTIFOCUS IMAGES , 2008 .

[18]  L. Yang,et al.  Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform , 2008, Neurocomputing.