Robust Multi-Focus Image Fusion Using Edge Model and Multi-Matting

An effective multi-focus image fusion method is proposed to generate an all-in-focus image with all objects in focus by merging multiple images. The proposed method first estimates focus maps using a novel combination of edge model and a traditional block-based focus measure. Then, a propagation process is conducted to obtain accurate weight maps based on a novel multi-matting model that makes full use of the spatial information. The fused all-in-focus image is finally generated based on a weighted-sum strategy. Experimental results demonstrate that the proposed method has state-of-the-art performance for multi-focus image fusion under various situations encountered in practice, even in cases with obvious misregistration.

[1]  Jie Liu,et al.  Multi-focus image fusion based on robust principal component analysis and pulse-coupled neural network , 2014 .

[2]  Shutao Li,et al.  Multifocus Image Fusion and Restoration With Sparse Representation , 2010, IEEE Transactions on Instrumentation and Measurement.

[3]  Yi Chai,et al.  Multifocus image fusion and denoising scheme based on homogeneity similarity , 2012 .

[4]  Xin Liu,et al.  A novel similarity based quality metric for image fusion , 2008, Inf. Fusion.

[5]  Rick S. Blum,et al.  A new automated quality assessment algorithm for image fusion , 2009, Image Vis. Comput..

[6]  Ananda S. Chowdhury,et al.  Steerable local frequency based multispectral multifocus image fusion , 2015, Inf. Fusion.

[7]  Pau-Choo Chung,et al.  A Fast Algorithm for Multilevel Thresholding , 2001, J. Inf. Sci. Eng..

[8]  Shutao Li,et al.  Image matting for fusion of multi-focus images in dynamic scenes , 2013, Inf. Fusion.

[9]  Andrea Fusiello,et al.  Generation of All-in-Focus Images by Noise-Robust Selective Fusion of Limited Depth-of-Field Images , 2013, IEEE Transactions on Image Processing.

[10]  Zhi Liu,et al.  Automatic segmentation of focused objects from images with low depth of field , 2010, Pattern Recognit. Lett..

[11]  Vladimir S. Petrovic,et al.  Objective pixel-level image fusion performance measure , 2000, SPIE Defense + Commercial Sensing.

[12]  Domenec Puig,et al.  Analysis of focus measure operators for shape-from-focus , 2013, Pattern Recognit..

[13]  Shutao Li,et al.  Performance comparison of different multi-resolution transforms for image fusion , 2011, Inf. Fusion.

[14]  Michael F. Cohen,et al.  Optimized Color Sampling for Robust Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  J. Canny A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2008 .

[17]  Yibo Chen,et al.  Edge model based fusion of multi-focus images using matting method , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[18]  Shadrokh Samavi,et al.  Multi-focus image fusion using dictionary-based sparse representation , 2015, Inf. Fusion.

[19]  Huei-Yung Lin,et al.  Depth from motion and defocus blur , 2006 .

[20]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[21]  Mei Yang,et al.  A novel algorithm of image fusion using shearlets , 2011 .

[22]  Yu Liu,et al.  Multi-focus image fusion with dense SIFT , 2015, Inf. Fusion.

[23]  Dani Lischinski,et al.  Spectral Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[25]  Jason Jianjun Gu,et al.  No-reference blur assessment based on edge modeling , 2015, J. Vis. Commun. Image Represent..

[26]  Qiang Zhang,et al.  Robust Multi-Focus Image Fusion Using Multi-Task Sparse Representation and Spatial Context , 2016, IEEE Transactions on Image Processing.

[27]  P.J.L. van Beek,et al.  Edge-Based Image Representation and Coding , 1995 .

[28]  Yi Shen,et al.  Region level based multi-focus image fusion using quaternion wavelet and normalized cut , 2014, Signal Process..

[29]  Guoliang Fan,et al.  Model-based edge reconstruction for low bit-rate wavelet-compressed images , 2000, IEEE Trans. Circuits Syst. Video Technol..

[30]  Yu Liu,et al.  A general framework for image fusion based on multi-scale transform and sparse representation , 2015, Inf. Fusion.

[31]  Tae-Sun Choi,et al.  Consideration of illumination effects and optimization of window size for accurate calculation of depth map for 3D shape recovery , 2007, Pattern Recognit..

[32]  Rüdiger Westermann,et al.  RANDOM WALKS FOR INTERACTIVE ALPHA-MATTING , 2005 .

[33]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[34]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[35]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  King Ngi Ngan,et al.  Unsupervized Video Segmentation With Low Depth of Field , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[37]  Zheng Liu,et al.  Objective Assessment of Multiresolution Image Fusion Algorithms for Context Enhancement in Night Vision: A Comparative Study , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  M. Hossny,et al.  Comments on 'Information measure for performance of image fusion' , 2008 .

[39]  Michael F. Cohen,et al.  Image and Video Matting: A Survey , 2007, Found. Trends Comput. Graph. Vis..

[40]  Ming Dai,et al.  Multifocus color image fusion based on quaternion curvelet transform. , 2012, Optics express.

[41]  Yu Liu,et al.  Simultaneous image fusion and denoising with adaptive sparse representation , 2015, IET Image Process..

[42]  Yuan Yan Tang,et al.  Multi-focus image fusion based on the neighbor distance , 2013, Pattern Recognit..

[43]  Yi Chai,et al.  Multifocus image fusion based on features contrast of multiscale products in nonsubsampled contourlet transform domain , 2012 .

[44]  Xiuqing Wu,et al.  A novel similarity based quality metric for image fusion , 2008, 2008 International Conference on Audio, Language and Image Processing.

[45]  Peter van Beek,et al.  An extensive empirical evaluation of focus measures for digital photography , 2014, Electronic Imaging.

[46]  Qiang Zhang,et al.  Multifocus image fusion using the nonsubsampled contourlet transform , 2009, Signal Process..

[47]  Shutao Li,et al.  Multifocus image fusion using region segmentation and spatial frequency , 2008, Image Vis. Comput..

[48]  Muralidhara Subbarao,et al.  Selecting the Optimal Focus Measure for Autofocusing and Depth-From-Focus , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  Kazuya Kodama,et al.  Efficient Reconstruction of All-in-Focus Images Through Shifted Pinholes From Multi-Focus Images for Dense Light Field Synthesis and Rendering , 2013, IEEE Transactions on Image Processing.

[50]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[51]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[52]  Stefano Soatto,et al.  A geometric approach to shape from defocus , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.