Multi-focus image fusion using learning based matting with sum of the Gaussian-based modified Laplacian

Abstract In most traditional multi-focus image fusion algorithms, the focus measures used to detect the focused areas of multiple images are unstable and sensitive to noise. Although many modified methods implement more sophisticated strategies to cope with this problem, the complexity of these methods turns out to be a problem for mobile devices. In order to cope with these problems, a novel multi-focus image fusion method based on image matting technique is put forward in this paper. This method is simple yet effective. Firstly, a new focus measure named the sum of the Gaussian-based modified Laplacian (SGML) is proposed to estimate the focus map of source images. Then, the initial segmentation map can be obtained via a novel sliding window strategy. Further, with the rough segmentation map as an input, learning based image matting technique is performed to extract the exact boundaries between focused and defocused regions. Finally, by combining the information of the focus areas, an all-in-focus image can be obtained. The numerous experiments have revealed that the proposed approach yielded better results in comparison with some competing techniques both in subjective and objective evaluation.

[1]  Hadi Seyedarabi,et al.  Multi-focus image fusion for visual sensor networks in DCT domain , 2011, Comput. Electr. Eng..

[2]  Yu Zhang,et al.  Quadtree-based multi-focus image fusion using a weighted focus-measure , 2015, Inf. Fusion.

[3]  Veysel Aslantas,et al.  A pixel based multi-focus image fusion method , 2014 .

[4]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[5]  Yuanjie Zheng,et al.  Learning based digital matting , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  Jason Jianjun Gu,et al.  Multi-focus image fusion using PCNN , 2010, Pattern Recognit..

[7]  Vinod Kumar,et al.  Feature-Motivated Simplified Adaptive PCNN-Based Medical Image Fusion Algorithm in NSST Domain , 2016, Journal of Digital Imaging.

[8]  Md. Arifur Rahman,et al.  Multi-focal image fusion using degree of focus and fuzzy logic , 2017, Digit. Signal Process..

[9]  Yi Shen,et al.  Region level based multi-focus image fusion using quaternion wavelet and normalized cut , 2014, Signal Process..

[10]  Yu Liu,et al.  Multi-focus image fusion with a deep convolutional neural network , 2017, Inf. Fusion.

[11]  Jie Yang,et al.  Multi-scale convolutional neural network for multi-focus image fusion , 2019, Image Vis. Comput..

[12]  Yu Liu,et al.  Multi-focus image fusion with dense SIFT , 2015, Inf. Fusion.

[13]  Huixin Zhou,et al.  Multi-focus image fusion using a guided-filter-based difference image. , 2016, Applied optics.

[14]  Kejia Zhang,et al.  Multi-focus image fusion algorithm based on Laplacian pyramids. , 2018, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  Baohua Zhang,et al.  Multi-focus image fusion based on sparse decomposition and background detection , 2016, Digit. Signal Process..

[16]  Shuaiqi Liu,et al.  Multi-focus image fusion based on joint sparse representation and optimum theory , 2019, Signal Process. Image Commun..

[17]  Mohammad Haghighat,et al.  Fast-FMI: Non-reference image fusion metric , 2014, 2014 IEEE 8th International Conference on Application of Information and Communication Technologies (AICT).

[18]  Oh-Jin Kwon,et al.  All-in-focus imaging using average filter-based relative focus measure , 2017, Digit. Signal Process..

[19]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[20]  Yu Zhang,et al.  Boundary finding based multi-focus image fusion through multi-scale morphological focus-measure , 2017, Inf. Fusion.

[21]  Gang Yang,et al.  Recovering Quantitative Remote Sensing Products Contaminated by Thick Clouds and Shadows Using Multitemporal Dictionary Learning , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Shutao Li,et al.  Multifocus Image Fusion and Restoration With Sparse Representation , 2010, IEEE Transactions on Instrumentation and Measurement.

[23]  Jin Longxu,et al.  General fusion method for infrared and visual images via latent low-rank representation and local non-subsampled shearlet transform , 2018 .

[24]  Xiaohua Qiu,et al.  Guided filter-based multi-focus image fusion through focus region detection , 2019, Signal Process. Image Commun..

[25]  Shutao Li,et al.  Image matting for fusion of multi-focus images in dynamic scenes , 2013, Inf. Fusion.

[26]  Haidawati Nasir,et al.  Singular value decomposition based fusion for super-resolution image reconstruction , 2011, 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[27]  Danilo P. Mandic,et al.  Multi-Scale Pixel-Based Image Fusion Using Multivariate Empirical Mode Decomposition , 2015, Sensors.

[28]  Shujun Liu,et al.  Image restoration approach using a joint sparse representation in 3D-transform domain , 2017, Digit. Signal Process..

[29]  Li Li,et al.  Multi-focus image fusion based on sparse feature matrix decomposition and morphological filtering , 2015 .

[30]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Zheng Liu,et al.  PERFORMANCE ASSESSMENT OF COMBINATIVE PIXEL-LEVEL IMAGE FUSION BASED ON AN ABSOLUTE FEATURE MEASUREMENT , 2007 .

[32]  Wencheng Wang,et al.  A Multi-focus Image Fusion Method Based on Laplacian Pyramid , 2011, J. Comput..

[33]  Xin Liu,et al.  A novel similarity based quality metric for image fusion , 2008, Inf. Fusion.

[34]  Rick S. Blum,et al.  A new automated quality assessment algorithm for image fusion , 2009, Image Vis. Comput..

[35]  Hanseok Ko,et al.  Joint patch clustering-based dictionary learning for multimodal image fusion , 2016, Inf. Fusion.

[36]  Bo Wang,et al.  Multi-focus image fusion based on multi-scale focus measures and generalized random walk , 2017, 2017 36th Chinese Control Conference (CCC).

[37]  Shutao Li,et al.  Pixel-level image fusion with simultaneous orthogonal matching pursuit , 2012, Inf. Fusion.

[38]  Niranjan Khandelwal,et al.  Multimodal medical image fusion using non-subsampled shearlet transform and pulse coupled neural network incorporated with morphological gradient , 2018, Signal Image Video Process..

[39]  Bo Wang,et al.  Multi-focus image fusion using boosted random walks-based algorithm with two-scale focus maps , 2019, Neurocomputing.

[40]  Michael F. Cohen,et al.  Image and Video Matting: A Survey , 2007, Found. Trends Comput. Graph. Vis..

[41]  Levente Kovács,et al.  Focus Area Extraction by Blind Deconvolution for Defining Regions of Interest , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Bhabatosh Chanda,et al.  Multi-focus image fusion using a morphology-based focus measure in a quad-tree structure , 2013, Inf. Fusion.

[43]  Sun Li,et al.  Multi-scale weighted gradient-based fusion for multi-focus images , 2014, Inf. Fusion.

[44]  Jing Tian,et al.  Adaptive multi-focus image fusion using a wavelet-based statistical sharpness measure , 2012, Signal Process..