Guided filter-based multi-focus image fusion through focus region detection

Abstract Being an efficient method of information fusion, multi-focus image fusion has attracted increasing interests in image processing and computer vision. This paper proposes a multi-focus image fusion method based on focus region detection using mean filter and guided filter. Firstly, a novel focus region detection method is presented, which uses guided filter to refine the rough focus maps obtained by mean filter and difference operator. Then, An initial decision map is got via the pixel-wise maximum rule, and optimized to generate final decision map by using guided filter again. Finally, the fused image is obtained by the pixel-wise weighted-averaging rule with the final decision map. Experimental results demonstrate that the novel focus region detection method has stronger robustness to different noises, and higher computational efficiency than other focus measures. Furthermore, the proposed fusion method implements efficiently and outperforms some state-of-the-art approaches both in visual effect and objective evaluation.

[1]  Kishor P. Upla,et al.  Multiresolution image fusion using edge-preserving filters , 2015 .

[2]  Yu Zhang,et al.  Multi-Focus Image Fusion Through Gradient- Based Decision Map Construction and Mathematical Morphology , 2016, IEEE Access.

[3]  Pan Lin,et al.  Multiple Visual Features Measurement With Gradient Domain Guided Filtering for Multisensor Image Fusion , 2017, IEEE Transactions on Instrumentation and Measurement.

[4]  Abdul Ghafoor,et al.  All in focus fusion using guided filter , 2015, Multidimens. Syst. Signal Process..

[5]  Ying Zhu,et al.  Review of Image Fusion Based on Pulse-Coupled Neural Network , 2015, Archives of Computational Methods in Engineering.

[6]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[7]  Yu Liu,et al.  Multi-focus image fusion with dense SIFT , 2015, Inf. Fusion.

[8]  Ying Zhu,et al.  Multi-focus Image Fusion Based on the Improved PCNN and Guided Filter , 2017, Neural Processing Letters.

[9]  Shutao Li,et al.  Multifocus image fusion using region segmentation and spatial frequency , 2008, Image Vis. Comput..

[10]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Sun Li,et al.  Multi-scale weighted gradient-based fusion for multi-focus images , 2014, Inf. Fusion.

[12]  Veysel Aslantas,et al.  A comparison of criterion functions for fusion of multi-focus noisy images , 2009 .

[13]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[14]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[15]  Xiuqing Wu,et al.  A novel similarity based quality metric for image fusion , 2008, 2008 International Conference on Audio, Language and Image Processing.

[16]  Mohammad Haghighat,et al.  Fast-FMI: Non-reference image fusion metric , 2014, 2014 IEEE 8th International Conference on Application of Information and Communication Technologies (AICT).

[17]  Li Zhao,et al.  Guided filter-based images fusion algorithm for CT and MRI medical images , 2018, IET Image Process..

[18]  Bao-Long Guo,et al.  Research on Image Fusion Based on the Nonsubsampled Contourlet Transform , 2007, 2007 IEEE International Conference on Control and Automation.

[19]  Nader Karimi,et al.  Surface area-based focus criterion for multi-focus image fusion , 2017, Inf. Fusion.

[20]  Yu Liu,et al.  A general framework for image fusion based on multi-scale transform and sparse representation , 2015, Inf. Fusion.

[21]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[22]  Zheng Liu,et al.  PERFORMANCE ASSESSMENT OF COMBINATIVE PIXEL-LEVEL IMAGE FUSION BASED ON AN ABSOLUTE FEATURE MEASUREMENT , 2007 .

[23]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[24]  Li Li,et al.  Multiscale infrared and visible image fusion using gradient domain guided image filtering , 2018 .

[25]  Zengchang Qin,et al.  Multifocus image fusion based on robust principal component analysis , 2013, Pattern Recognit. Lett..

[26]  Zhifeng Gao,et al.  Fusion of infrared and visible images for night-vision context enhancement. , 2016, Applied optics.

[27]  Yu Zhang,et al.  Boundary finding based multi-focus image fusion through multi-scale morphological focus-measure , 2017, Inf. Fusion.

[28]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[29]  Yu Liu,et al.  Multi-focus image fusion with a deep convolutional neural network , 2017, Inf. Fusion.

[30]  Zhenhong Jia,et al.  Remote sensing image enhancement based on the combination of nonsubsampled shearlet transform and guided filtering , 2016 .

[31]  Yi Liu,et al.  Sparse representation based multi-sensor image fusion for multi-focus and multi-modality images: A review , 2018, Inf. Fusion.

[32]  Pan Lin,et al.  Multifocus Image Fusion Based on NSCT and Focused Area Detection , 2014, IEEE Sensors Journal.

[33]  Hadi Seyedarabi,et al.  A non-reference image fusion metric based on mutual information of image features , 2011, Comput. Electr. Eng..

[34]  Oliver Rockinger,et al.  Image sequence fusion using a shift-invariant wavelet transform , 1997, Proceedings of International Conference on Image Processing.

[35]  Huixin Zhou,et al.  Multi-focus image fusion using a guided-filter-based difference image. , 2016, Applied optics.

[36]  Alexander Toet,et al.  Iterative guided image fusion , 2016, PeerJ Comput. Sci..

[37]  Zhao Jie,et al.  Multi-Focus Image Fusion using Self-Similarity and Depth Information in Nonsubsampled Shearlet Transform Domain , 2016 .

[38]  Zheng Liu,et al.  Objective Assessment of Multiresolution Image Fusion Algorithms for Context Enhancement in Night Vision: A Comparative Study , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Rick S. Blum,et al.  A new automated quality assessment algorithm for image fusion , 2009, Image Vis. Comput..

[40]  Yu Zhang,et al.  Quadtree-based multi-focus image fusion using a weighted focus-measure , 2015, Inf. Fusion.

[41]  Mehdi Nooshyar,et al.  Multi-focus image fusion using sharpness criteria for visual sensor networks in wavelet domain , 2016, Comput. Electr. Eng..

[42]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[43]  Jingwen Yan,et al.  High quality multi-focus image fusion using self-similarity and depth information , 2015 .

[44]  Salvador Gabarda,et al.  Anisotropy-based robust focus measure for non-mydriatic retinal imaging. , 2012, Journal of biomedical optics.

[45]  Shutao Li,et al.  Image matting for fusion of multi-focus images in dynamic scenes , 2013, Inf. Fusion.

[46]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[47]  Yunsong Li,et al.  Fusion of hyperspectral and panchromatic images using an average filter and a guided filter , 2018, J. Vis. Commun. Image Represent..