Analysis and Application Based on GTF Infrared and Visible Image Fusion

From 1997 to 2006, China's railway has undergone six large-scale speed-raising reconstruction, and some of the speed has reached 250KM/h. With the development of train speed, the pantograph-cantenary system becomes more and more important. Since infrared image has light penetration, this paper fuses infrared and visible images to get more information about the pantograph-cantenary so that train drivers can learn more about the pantograph-cantenary situation. Existing fusion methods typically use the same representations and extract the similar characteristics for different source images. However, it may don’t work for infrared and visible images. In this paper, we use the fusion algorithm named Gradient Transfer Fusion (GTF), which can keep the thermal radiation and appearance information simultaneously. To prove the effectiveness of the GTF method, it is compared with other 17 fusion algorithms from quantitative aspects. Furthermore, the parameter in the GTF method is analyzed and selected for better fusion results. Finally, color image fusion which is an improvement to the GTF method preserving the color information of the visible image in the fused image is proposed and it is tested on publicly available data sets to prove its availability.

[1]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[2]  Yu Liu,et al.  A general framework for image fusion based on multi-scale transform and sparse representation , 2015, Inf. Fusion.

[3]  Huimin Lu,et al.  Maximum local energy: An effective approach for multisensor image fusion in beyond wavelet transform domain , 2012, Comput. Math. Appl..

[4]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[5]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[6]  Vps Naidu,et al.  Image Fusion Technique using Multi-resolution Singular Value Decomposition , 2011 .

[7]  Hui Zhao,et al.  Multi-focus color image fusion in the HSI space using the sum-modified-laplacian and a coarse edge map , 2008, Image Vis. Comput..

[8]  R. Lu,et al.  Comparison and fusion of four nondestructive sensors for predicting apple fruit firmness and soluble solids content , 2012 .

[9]  Jiayi Ma,et al.  Infrared and visible image fusion via gradient transfer and total variation minimization , 2016, Inf. Fusion.

[10]  Tony F. Chan,et al.  Aspects of Total Variation Regularized L[sup 1] Function Approximation , 2005, SIAM J. Appl. Math..

[11]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[12]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[13]  G. Turhan-Sayan,et al.  Real time electromagnetic target classification using a novel feature extraction technique with PCA-based fusion , 2005, IEEE Transactions on Antennas and Propagation.

[14]  Laure J. Chipman,et al.  Wavelets and image fusion , 1995, Proceedings., International Conference on Image Processing.

[15]  Y. Kiran Kumar,et al.  COMPARISON OF FUSION TECHNIQUES APPLIED TO PRECLINICAL IMAGES: FAST DISCRETE CURVELET TRANSFORM USING WRAPPING TECHNIQUE & WAVELET TRANSFORM , 2009 .

[16]  M. Nikolova.  An Algorithm for Total Variation Minimization and Applications , 2004 .

[17]  Nasir M. Rajpoot,et al.  Registration of thermal and visible light images of diseased plants using silhouette extraction in the wavelet domain , 2015, Pattern Recognit..

[18]  Wang Xin,et al.  A New Multi-source Image Sequence Fusion Algorithm Based on SIDWT , 2013, 2013 Seventh International Conference on Image and Graphics.

[19]  Gang Liu,et al.  Color fusion based on EM algorithm for IR and visible image , 2010, 2010 The 2nd International Conference on Computer and Automation Engineering (ICCAE).

[20]  Deng Jun-jun.  Design of a Fire Detection System Based on Pyroelectric Infrared Sensor , 2007 .

[21]  Hemalata Bhujle.  Weighted-average fusion method for multiband images , 2016, 2016 International Conference on Signal Processing and Communications (SPCOM).

[22]  Rick S. Blum,et al.  Concealed weapon detection using color image fusion , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[23]  Abdul Jalil,et al.  Fusion of color and infrared images using gradient transfer and total variation minimization , 2017, 2017 2nd International Conference on Computer and Communication Systems (ICCCS).

[24]  L. Yang,et al.  Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform , 2008, Neurocomputing.

[25]  K. P. Soman,et al.  Implementation and Comparative Study of Image Fusion Algorithms , 2010 .