Infrared and visible image fusion using co-occurrence filter

Abstract In this paper, an effective image fusion method for infrared image and visible image is proposed for generating a high-quality fused image to deal with the issue that existing image fusion methods suffer from loss of tiny details. The major contributions are as follows: (1) We apply the Co-occurrence filter (CoF), a recently proposed edge-preserving technique, to image fusion and propose a CoF-based image fusion framework to merge tiny details of the multiple input images. The fusion processing is respectively performed on the base layer and the detail layer, which are decomposed by the simple gaussian filter. (2) We propose a novel strategy to fuse the base layers and detail layers. The CoF is adopted directly to fuse the detail layer and an iterative CoF is used to fuse the base layer. It is demonstrated through experimental results and evaluations that the proposed method outperforms the state-of-the-art fusion methods with respect to edge preserving by both subjective evaluation and objective assessment.

[1]  Qian Chen,et al.  Robust infrared small target detection via non-negativity constraint-based sparse representation. , 2016, Applied optics.

[2]  Guohua Gu,et al.  Infrared small target enhancement: grey level mapping based on improved sigmoid transformation and saliency histogram , 2018 .

[3]  Michel Grédiac,et al.  Heat source reconstruction from noisy temperature fields using an optimised derivative Gaussian filter , 2013 .

[4]  Ali Mohammadzadeh,et al.  Developing a Spectral-Based Strategy for Urban Object Detection From Airborne Hyperspectral TIR and Visible Data , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  Michel Grédiac,et al.  Heat source reconstruction from noisy temperature fields using a gradient anisotropic diffusion filter , 2017 .

[6]  Yu Han,et al.  A new image fusion performance metric based on visual information fidelity , 2013, Inf. Fusion.

[7]  Yongjun Zhang,et al.  Salient Object Detection via Recursive Sparse Representation , 2018, Remote. Sens..

[8]  Vps Naidu,et al.  Image Fusion Technique using Multi-resolution Singular Value Decomposition , 2011 .

[9]  André Chrysochoos,et al.  An infrared image processing to analyse the calorific effects accompanying strain localisation , 2000 .

[10]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[11]  Ravindra Dhuli,et al.  Two-scale image fusion of visible and infrared images using saliency detection , 2016 .

[12]  Zijun Feng,et al.  Infrared Target Detection and Location for Visual Surveillance Using Fusion Scheme of Visible and Infrared Images , 2013 .

[13]  George P. Lemeshewsky Multispectral multisensor image fusion using wavelet transforms , 1999, Defense, Security, and Sensing.

[14]  Zhifeng Gao,et al.  Fusion of infrared and visible images for night-vision context enhancement. , 2016, Applied optics.

[15]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[16]  Bo Gu,et al.  Gradient field multi-exposure images fusion for high dynamic range image visualization , 2012, J. Vis. Commun. Image Represent..

[17]  N. Ranc,et al.  POD Preprocessing of IR Thermal Data to Assess Heat Source Distributions , 2015 .

[18]  Xiaohai He,et al.  Infrared and visible image fusion with the use of multi-scale edge-preserving decomposition and guided image filter , 2015 .

[19]  Nishan Canagarajah,et al.  A Similarity Metric for Assessment of Image Fusion Algorithms , 2008 .

[20]  Xia Xu,et al.  Hierarchical Guidance Filtering-Based Ensemble Classification for Hyperspectral Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Nasir M. Rajpoot,et al.  Registration of thermal and visible light images of diseased plants using silhouette extraction in the wavelet domain , 2015, Pattern Recognit..

[22]  Qiang Zhang,et al.  Multifocus image fusion using the nonsubsampled contourlet transform , 2009, Signal Process..

[23]  Yu Liu,et al.  A general framework for image fusion based on multi-scale transform and sparse representation , 2015, Inf. Fusion.

[24]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[25]  Jiayi Ma,et al.  Infrared and visible image fusion via gradient transfer and total variation minimization , 2016, Inf. Fusion.

[26]  M. Hossny,et al.  Comments on 'Information measure for performance of image fusion' , 2008 .

[27]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[28]  Rabab Kreidieh Ward,et al.  Image Fusion With Convolutional Sparse Representation , 2016, IEEE Signal Processing Letters.

[29]  Zhizhong Fu,et al.  Infrared and visible images fusion based on RPCA and NSCT , 2016 .

[30]  Veysel Aslantas,et al.  Fusion of multi-focus images using differential evolution algorithm , 2010, Expert Syst. Appl..

[31]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[32]  Yu Zhang,et al.  Quadtree-based multi-focus image fusion using a weighted focus-measure , 2015, Inf. Fusion.

[33]  Kan Ren,et al.  Super-resolution images fusion via compressed sensing and low-rank matrix decomposition , 2015 .

[34]  Yu Liu,et al.  Multi-focus image fusion with dense SIFT , 2015, Inf. Fusion.

[35]  Chongzhao Han,et al.  Poisson image fusion based on Markov random field fusion model , 2013, Inf. Fusion.