Edge Preserving Image Fusion using Intensity Variation Approach

In this article, a novel edge preserving image fusion method is proposed by merging multiple images captured from different imaging sensors. The objective of this paper is to highlight the informative contents of multiple images into a single fused image. Fusion of data from multiple sensors is a difficult task as the imaging modality are different and sensors capturing the data may be affected by sensors noise. As the images captured from multiple sensors possess uncertainty within a pixel due to the multi-valued level of brightness. It is obvious that a deterministic method of fusion may not give a better results. Hence, it is required to explore the use of fuzzy sets theoretic approaches in this regard. The proposed scheme follow three stages. In the first stage of the algorithm, a resultant image is obtained by setting the maximum value between the pixel intensity of visible and infrared sub-images considered within a small spatial neighborhood. The edges of the visible image are preserved in the second stage of the algorithm using a Fuzzy edge technique. Finally the fused image is obtained by combining the obtained resultant image and the edges of the visible image. In order to evaluate the performance of the proposed method quantitatively, and qualitatively experiments were carried out on publicly available benchmark database, "TNO-database". The proposed method is compared with those of eight state-of-the-arts techniques. The experimental results of the proposed method attained state-of-the-art performance in objective assessment and visual quality assessment.

[1]  Hui Li,et al.  Infrared and Visible Image Fusion with ResNet and zero-phase component analysis , 2018, Infrared Physics & Technology.

[2]  Jiayi Ma,et al.  Infrared and visible image fusion methods and applications: A survey , 2018, Inf. Fusion.

[3]  Vikram M. Gadre,et al.  Visible and NIR image fusion using weight-map-guided Laplacian–Gaussian pyramid for improving scene visibility , 2017, Sādhanā.

[4]  David R. Bull,et al.  Perceptual Image Fusion Using Wavelets , 2017, IEEE Transactions on Image Processing.

[5]  Yan Wang,et al.  Infrared and multi-type images fusion algorithm based on contrast pyramid transform , 2016 .

[6]  Jun Chen,et al.  Infrared and visible image fusion using total variation model , 2016, Neurocomputing.

[7]  Jianping Fan,et al.  Fusion method for infrared and visible images by using non-negative sparse representation , 2014 .

[8]  Toet Alexander,et al.  TNO Image Fusion Dataset , 2014 .

[9]  Yu Han,et al.  A new image fusion performance metric based on visual information fidelity , 2013, Inf. Fusion.

[10]  Karim Faez,et al.  Infrared and visible image fusion using fuzzy logic and population-based optimization , 2012, Appl. Soft Comput..

[11]  Hideya Takahashi,et al.  Fusion of Infrared and Visible Images for Robust Person Detection , 2011 .

[12]  Mrityunjay Kumar,et al.  A Total Variation-Based Algorithm for Pixel-Level Image Fusion , 2009, IEEE Transactions on Image Processing.

[13]  S. G. Nikolov,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[14]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[15]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[16]  Sven Loncaric,et al.  A survey of shape analysis techniques , 1998, Pattern Recognit..

[17]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[18]  S. Pal,et al.  Image enhancement using smoothing with fuzzy sets , 1981 .

[19]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[20]  Alan L. Yuille,et al.  Non-Rigid Point Set Registration by Preserving Global and Local Structures , 2016, IEEE Transactions on Image Processing.

[21]  A. Hegde Pixel Level Image Fusion – A Review on Various Techniques , 2014 .

[22]  Sankar K. Pal,et al.  On Edge Detection of X-Ray Images Using Fuzzy Sets , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.