Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition

Fusion method of infrared and visible images to a synthetic image is a significant research topic in image process. It is an effective way to extract the detail information of the visible image and target regions of the infrared image in the final fused result. In this paper, a detail preserved fusion algorithm of visible and infrared images is proposed based on the regional saliency extraction technique and multi scale image decomposition. The multi-scale image decomposition is firstly applied to the infrared and visible images under the image smoothing framework using L1 fidelity with L0 gradient. Then for each decomposition layer the saliency map is extracted by the frequency-tuned saliency map extraction algorithm. The final fused result is reconstructed by synthesizing different levels with proper weight values. Experiments are implemented to test the performance of the proposed fusion approach compared with other excellent fusion methods. Both the subjective perception and quantitative index results demonstrate that the proposed approach obtains better performance in preserving the edge detail information as well as enhancing the infrared targert signals.

[1]  Qi Li,et al.  Infrared image enhancement through saliency feature analysis based on multi-scale decomposition , 2014 .

[2]  Haixu Wang,et al.  Multimodal medical image fusion based on IHS and PCA , 2010 .

[3]  J. Wesley Roberts,et al.  Assessment of image fusion procedures using entropy, image quality, and multispectral classification , 2008 .

[4]  Zhongliang Jing,et al.  Multi-focus image fusion using pulse coupled neural network , 2007, Pattern Recognit. Lett..

[5]  Rafael García,et al.  Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Haiyan Jin,et al.  A fusion method for visible and infrared images based on contrast pyramid with teaching learning based optimization , 2014 .

[7]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[8]  Qi Li,et al.  Fusion of visible and infrared images using saliency analysis and detail preserving based image decomposition , 2013 .

[9]  Q Guihong,et al.  Medical image fusion by wavelet transform modulus maxima. , 2001, Optics express.

[10]  Shutao Li,et al.  Multifocus image fusion using region segmentation and spatial frequency , 2008, Image Vis. Comput..

[11]  David Bull,et al.  Region-Based Multimodal Image Fusion Using ICA Bases , 2007 .

[12]  Xiangzhi Bai,et al.  Multiscale top-hat selection transform based infrared and visual image fusion with emphasis on extracting regions of interest , 2013 .

[13]  Yang Lei,et al.  Novel fusion method for visible light and infrared images based on NSST–SF–PCNN , 2014 .

[14]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[15]  Bhabatosh Chanda,et al.  Fusion of 2D grayscale images using multiscale morphology , 2001, Pattern Recognit..

[16]  Alexander Toet,et al.  Perceptual evaluation of different image fusion schemes , 2003 .

[17]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[18]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[19]  George K. Matsopoulos,et al.  Application of Morphological Pyramids: Fusion of MR and CT Phantoms , 1995, J. Vis. Commun. Image Represent..

[20]  Qi Li,et al.  Detail enhanced multi-source fusion using visual weight map extraction based on multi scale edge preserving decomposition , 2013 .

[21]  Xiangzhi Bai,et al.  Fusion of infrared and visual images through region extraction by using multi scale center-surround top-hat transform. , 2011, Optics express.

[22]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[23]  Yan Wang,et al.  Image fusion based on nonsubsampled contourlet transform for infrared and visible light image , 2013 .

[24]  Luciano Alparone,et al.  Remote sensing image fusion using the curvelet transform , 2007, Inf. Fusion.

[25]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[26]  Vassilia Karathanassi,et al.  Investigation of the Dual-Tree Complex and Shift-Invariant Discrete Wavelet Transforms on Quickbird Image Fusion , 2007, IEEE Geoscience and Remote Sensing Letters.

[27]  Rui Wang,et al.  Infrared and visible image fusion based on random projection and sparse representation , 2014 .

[28]  Jason Jianjun Gu,et al.  Multi-focus image fusion using PCNN , 2010, Pattern Recognit..

[29]  Leonel Sousa,et al.  General method for eliminating redundant computations in video coding , 2000 .

[30]  Li Wei,et al.  Research on fusion method for infrared and visible images via compressive sensing , 2013 .

[31]  Victor Alchanatis,et al.  Image fusion of visible and thermal images for fruit detection. , 2009 .

[32]  S. Pei,et al.  Edge-preserving image decomposition using L1 fidelity with L0 gradient , 2012, SIGGRAPH Asia Technical Briefs.