Multi-focus image fusion based on depth estimation in HSV space

A robust multi-focus image fusion method is proposed to generate an all-in-focus image with all objects in focus by merging multiple images. The proposed method first estimates local focus maps using a novel measure of Gaussian model combined with joint bilateral filtering in HSV space. Then, a propagation process is conducted to obtain accurate focus maps based on a traditional natural image matting model that makes full use of the spatial information. The fused all-infocus image is finally generated by a focus-selected strategy. Experimental results demonstrate that the proposed method has state-of-the-art performance for multi-focus image fusion under various situations encountered in practice, even in cases with little edge information.

[1]  Yuan Yan Tang,et al.  Multi-focus image fusion based on the neighbor distance , 2013, Pattern Recognit..

[2]  Yi Chai,et al.  Multifocus image fusion based on features contrast of multiscale products in nonsubsampled contourlet transform domain , 2012 .

[3]  Susanto Rahardja,et al.  A New Multi-Focus Image Fusion Algorithm and Its Efficient Implementation , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[5]  Qiang Zhang,et al.  Multifocus image fusion using the nonsubsampled contourlet transform , 2009, Signal Process..

[6]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[7]  Kejia Zhang,et al.  Multi-focus image fusion algorithm based on Laplacian pyramids. , 2018, Journal of the Optical Society of America. A, Optics, image science, and vision.

[8]  Ming Dai,et al.  Multifocus color image fusion based on quaternion curvelet transform. , 2012, Optics express.

[9]  Mei Yang,et al.  A novel algorithm of image fusion using shearlets , 2011 .

[10]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Shutao Li,et al.  Performance comparison of different multi-resolution transforms for image fusion , 2011, Inf. Fusion.

[12]  Yi Shen,et al.  Region level based multi-focus image fusion using quaternion wavelet and normalized cut , 2014, Signal Process..

[13]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[14]  LiShutao,et al.  Pixel-level image fusion , 2017 .

[15]  Ananda S. Chowdhury,et al.  Steerable local frequency based multispectral multifocus image fusion , 2015, Inf. Fusion.

[16]  Stavri G. Nikolov,et al.  Image fusion: Advances in the state of the art , 2007, Inf. Fusion.

[17]  Panajotis Agathoklis,et al.  A wavelet based method for image reconstruction from gradient data with applications , 2013, Multidimensional Systems and Signal Processing.

[18]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[19]  Terence Sim,et al.  Defocus map estimation from a single image , 2011, Pattern Recognit..