Fusion of Infrared and Visible Images through a Hybrid Image Decomposition and Sparse Representation

Aiming at the fusion of the infrared and visible images, a novel image fusion framework based on hybrid image decomposition and sparse representation is proposed in this paper. Firstly, the Gaussian and guided filters are used to decompose the source images into the small-scale texture details, large-scale edge and coarse-scale image information. The main infrared features are maintained in the large-scale edge information, which are used to determine the fused weights for the coarse-scale information. The sparse representation based fusion method is adopted for the fusion of the small-scale texture details and large-scale edge information, which makes the final fused image can effectively highlight the infrared targets, while preserving the texture details of the visible images as much as possible. So, the fused image is more consistent with the human visual perception effect. Experimental results show that method is superior to the currently used popular image fusion methods.

[1]  Zhaodong Liu,et al.  A novel image fusion approach based on compressive sensing , 2015 .

[2]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[3]  Shaowen Yao,et al.  A survey of infrared and visual image fusion methods , 2017 .

[4]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[5]  Zhaodong Liu,et al.  A novel fusion scheme for visible and infrared images based on compressive sensing , 2015 .

[6]  Hanseok Ko,et al.  Joint patch clustering-based dictionary learning for multimodal image fusion , 2016, Inf. Fusion.

[7]  Yi Liu,et al.  Sparse representation based multi-sensor image fusion for multi-focus and multi-modality images: A review , 2018, Inf. Fusion.

[8]  Shutao Li,et al.  Multifocus Image Fusion and Restoration With Sparse Representation , 2010, IEEE Transactions on Instrumentation and Measurement.

[9]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[10]  J. Romberg,et al.  Imaging via Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[11]  Sun Li,et al.  Perceptual fusion of infrared and visible images through a hybrid multi-scale decomposition with Gaussian and bilateral filters , 2016, Inf. Fusion.

[12]  Yu Liu,et al.  A general framework for image fusion based on multi-scale transform and sparse representation , 2015, Inf. Fusion.

[13]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[14]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[15]  Zheng Liu,et al.  Objective Assessment of Multiresolution Image Fusion Algorithms for Context Enhancement in Night Vision: A Comparative Study , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[17]  Leonard McMillan,et al.  Multispectral Bilateral Video Fusion , 2007, IEEE Transactions on Image Processing.

[18]  Yu Zhang,et al.  Infrared and visual image fusion through infrared feature extraction and visual information preservation , 2017 .