Multi-focal image fusion using degree of focus and fuzzy logic

Abstract The continuous advancement in the field of imaging sensor necessitates the development of an efficient image fusion technique. The multi-focal image fusion extracts the in-focus information from the source images to construct a single composite image with increased depth-of-field. Traditionally, the information in multi-focal images is divided into two categories: in-focus and out-of-focus data. Instead of using a binary focus map, in this work we calculate the degree of focus for each source image using fuzzy logic. The fused image is then generated based on the weighted sum of this information. An initial focus tri-state map is built for each input image by using spatial frequency and a proposed focus measure named as alternate sum modified Laplacian. For the cases where these measures indicate different source images to contain focused pixel or have equal strength, another focus measure based on sum of gradient is employed to calculate the degree of focus in a fuzzy inference system. Finally, the fused image is computed from the weights determined by the degree of focus map of each image. The proposed algorithm is designed to fuse two source images, whereas fusion of multiple input images can be performed by fusing a source image with the fusion output of the previous input group. The comparison of the proposed method with several transform and pixel domain based techniques are conducted in terms of both subjective visual assessment and objective quantitative evaluation. Experimental results demonstrate that our method can be competitive with or even outperforms the methods in comparison.

[1]  Yu Liu,et al.  Multi-focus image fusion with dense SIFT , 2015, Inf. Fusion.

[2]  Abdesselam Bouzerdoum,et al.  Fuzzy Logic-Based Image Fusion for Multi-view Through-the-Wall Radar , 2010, 2010 International Conference on Digital Image Computing: Techniques and Applications.

[3]  Shutao Li,et al.  Image matting for fusion of multi-focus images in dynamic scenes , 2013, Inf. Fusion.

[4]  Bhabatosh Chanda,et al.  Enhancing effective depth-of-field by image fusion using mathematical morphology , 2006, Image Vis. Comput..

[5]  Yaonan Wang,et al.  Multifocus image fusion using artificial neural networks , 2002, Pattern Recognit. Lett..

[6]  T. Ross Fuzzy Logic with Engineering Applications , 1994 .

[7]  Huiping Zhou,et al.  Remote sensing image fusion based on fuzzy theory in pixel level and assessing the quality of resulting images , 2007, Geoinformatics.

[8]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[9]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[10]  Yi Chai,et al.  Multi-focus image fusion based on nonsubsampled contourlet transform and focused regions detection , 2013 .

[11]  Veysel Aslantas,et al.  A pixel based multi-focus image fusion method , 2014 .

[12]  Yong Yang,et al.  Effective Multifocus Image Fusion Based on HVS and BP Neural Network , 2014, TheScientificWorldJournal.

[13]  Shadrokh Samavi,et al.  Multi-focus image fusion using dictionary-based sparse representation , 2015, Inf. Fusion.

[14]  Yaonan Wang,et al.  Combination of images with diverse focuses using the spatial frequency , 2001, Inf. Fusion.

[15]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[16]  Zengchang Qin,et al.  Multifocus image fusion based on robust principal component analysis , 2013, Pattern Recognit. Lett..

[17]  Hadi Seyedarabi,et al.  Multi-focus image fusion for visual sensor networks in DCT domain , 2011, Comput. Electr. Eng..

[18]  Veysel Aslantas,et al.  Fusion of multi-focus images using differential evolution algorithm , 2010, Expert Syst. Appl..

[19]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  T. Meitzler,et al.  Fuzzy Logic Based Image Fusion , 2002 .

[21]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[22]  B. K. Shreyamsha Kumar,et al.  Image fusion based on pixel significance using cross bilateral filter , 2013, Signal, Image and Video Processing.

[23]  屈小波 Xiaobo Qu,et al.  Image Fusion Algorithm Based on Spatial Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain , 2008 .

[24]  Md. Arifur Rahman,et al.  Multisensor multichannel image fusion based on fuzzy logic , 2014, 2014 11th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[25]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[26]  Shutao Li,et al.  Multifocus Image Fusion and Restoration With Sparse Representation , 2010, IEEE Transactions on Instrumentation and Measurement.

[27]  Alexander Toet,et al.  A morphological pyramidal image decomposition , 1989, Pattern Recognit. Lett..

[28]  Malay Kumar Kundu,et al.  Corrections to "A Neuro-Fuzzy Approach for Medical Image Fusion" , 2015, IEEE Trans. Biomed. Eng..

[29]  Faliang Chang,et al.  Fusion of Multi-focus Images Based on the 2-Generation Curvelet Transform , 2011 .

[30]  Yu Zhang,et al.  Quadtree-based multi-focus image fusion using a weighted focus-measure , 2015, Inf. Fusion.

[31]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[32]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[33]  Shutao Li,et al.  Multifocus image fusion using region segmentation and spatial frequency , 2008, Image Vis. Comput..

[34]  Uday B. Desai,et al.  Multifocus and multispectral image fusion based on pixel significance using multiresolution decomposition , 2013, Signal Image Video Process..

[35]  Hadi Seyedarabi,et al.  A non-reference image fusion metric based on mutual information of image features , 2011, Comput. Electr. Eng..

[36]  M. A. Rahman,et al.  Efficient colour image compression using fusion approach , 2016 .

[37]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[38]  Shutao Li,et al.  Performance comparison of different multi-resolution transforms for image fusion , 2011, Inf. Fusion.

[39]  Pagavathigounder Balasubramaniam,et al.  Image fusion using intuitionistic fuzzy sets , 2014, Inf. Fusion.

[40]  Bhabatosh Chanda,et al.  Multi-focus image fusion using a morphology-based focus measure in a quad-tree structure , 2013, Inf. Fusion.

[41]  Zhongliang Jing,et al.  Multi-focus image fusion using pulse coupled neural network , 2007, Pattern Recognit. Lett..

[42]  Masaaki Ikehara,et al.  All-in-focus photo image creation by wavelet transforms , 2007 .

[43]  Vladimir Petrovic,et al.  Objective image fusion performance characterisation , 2005, ICCV 2005.

[44]  Chongzhao Han,et al.  Poisson image fusion based on Markov random field fusion model , 2013, Inf. Fusion.

[45]  R. Bert \IBe the Solution: How Entrepreneurs and Conscious Capitalists Can Solve All the World’s Problems\N by Michael Strong. Hoboken, New Jersey: John Wiley & Sons, 2000. , 2009 .

[46]  B. K. Shreyamsha Kumar,et al.  Multifocus and multispectral image fusion based on pixel significance using discrete cosine harmonic wavelet transform , 2013, Signal Image Video Process..

[47]  Shutao Li,et al.  Multi-focus image fusion based on spatial frequency and morphological operators , 2007 .