All-in-focus imaging using average filter-based relative focus measure

Abstract Digital images are normally taken by focusing on an object, resulting in defocused background regions. A popular approach to produce an all-in-focus image without defocused regions is to capture several input images at varying focus settings, and then fuse them into an image using offline image processing software. This paper describes an all-in-focus imaging method that can operate on digital cameras. The proposed method consists of an automatic focus-bracketing algorithm that determines at which focuses to capture images and an image-fusion algorithm that computes a high-quality all-in-focus image. While most previous methods use the focus measure calculated independently for each input image, the proposed method calculates the relative focus measure between a pair of input images. We note that a well-focused region in an image shows better contrast, sharpness, and details than the corresponding region that is defocused in another image. Based on the observation that the average filtered version of a well-focused region in an image shows a higher correlation to the corresponding defocused region in another image than the original well-focused version, a new focus measure is proposed. Experimental results of various sample image sequences show the superiority of the proposed measure in terms of both objective and subjective evaluation and the proposed method allows the user to capture all-in-focus images directly on their digital camera without using offline image processing software.

[1]  Yi Chai,et al.  Multifocus image fusion and denoising scheme based on homogeneity similarity , 2012 .

[2]  Mei Yang,et al.  Multi-focus image fusion algorithm based on shearlets , 2011 .

[3]  Vps Naidu Multi focus image fusion using the measure of focus , 2012 .

[4]  Yaonan Wang,et al.  Combination of images with diverse focuses using the spatial frequency , 2001, Inf. Fusion.

[5]  Gabriel Cristóbal,et al.  Multifocus image fusion using the log-Gabor transform and a Multisize Windows technique , 2009, Inf. Fusion.

[6]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Kai-Lung Hua,et al.  A novel multi-focus image fusion algorithm based on random walks , 2014, J. Vis. Commun. Image Represent..

[8]  Li Chen,et al.  Multi-focus image fusion using a bilateral gradient-based sharpness criterion , 2011 .

[9]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[10]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[11]  Shutao Li,et al.  Multifocus image fusion using region segmentation and spatial frequency , 2008, Image Vis. Comput..

[12]  Shutao Li,et al.  Image matting for fusion of multi-focus images in dynamic scenes , 2013, Inf. Fusion.

[13]  Gaofeng Meng,et al.  Multifocus image fusion via focus segmentation and region reconstruction , 2014, Neurocomputing.

[14]  Zhou Wang,et al.  Objective Quality Assessment of Tone-Mapped Images , 2013, IEEE Transactions on Image Processing.

[15]  Patrick Le Callet,et al.  Tone mapping based HDR compression: Does it affect visual experience? , 2014, Signal Process. Image Commun..

[16]  Nasser Kehtarnavaz,et al.  Development and real-time implementation of a rule-based auto-focus algorithm , 2003, Real Time Imaging.

[17]  Nasser Kehtarnavaz,et al.  Real-Time Implementation Issues in Passive Automatic Focusing for Digital Still Cameras , 2005, Journal of Imaging Science and Technology.

[18]  M. Hossny,et al.  Comments on 'Information measure for performance of image fusion' , 2008 .

[19]  Qiang Zhang,et al.  Multifocus image fusion using the nonsubsampled contourlet transform , 2009, Signal Process..

[20]  Andrea Fusiello,et al.  Generation of All-in-Focus Images by Noise-Robust Selective Fusion of Limited Depth-of-Field Images , 2013, IEEE Transactions on Image Processing.

[21]  Jinbo Li,et al.  Regional multifocus image fusion using sparse representation. , 2013, Optics express.

[22]  Shao Zhenfeng,et al.  Fusion of infrared and visible images based on focus measure operators in the curvelet domain. , 2012, Applied optics.

[23]  Kang-Sun Choi,et al.  New autofocusing technique using the frequency selective weighted median filter for video cameras , 1999, IEEE Trans. Consumer Electron..

[24]  Shuyuan Yang,et al.  Image fusion based on a new contourlet packet , 2010, Inf. Fusion.

[25]  Georgios D. Evangelidis,et al.  Parametric Image Alignment Using Enhanced Correlation Coefficient Maximization , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Wencheng Wang,et al.  A Multi-focus Image Fusion Method Based on Laplacian Pyramid , 2011, J. Comput..

[27]  Sun Li,et al.  Multi-scale weighted gradient-based fusion for multi-focus images , 2014, Inf. Fusion.

[28]  Yuan Yan Tang,et al.  Multi-focus image fusion based on the neighbor distance , 2013, Pattern Recognit..

[29]  Sim Heng Ong,et al.  Autofocusing for tissue microscopy , 1993, Image Vis. Comput..

[30]  Xiongfei Li,et al.  Multi-focus image fusion using image-partition-based focus detection , 2014, Signal Process..

[31]  Gaurav Bhatnagar,et al.  Mutual spectral residual approach for multifocus image fusion , 2013, Digit. Signal Process..

[32]  Sos S. Agaian,et al.  No reference color image contrast and quality measures , 2013, IEEE Transactions on Consumer Electronics.

[33]  Joonki Paik,et al.  Fully digital auto-focusing system with automatic focusing region selection and point spread function estimation , 2010, IEEE Transactions on Consumer Electronics.

[34]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[35]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[36]  Veysel Aslantas,et al.  A comparison of criterion functions for fusion of multi-focus noisy images , 2009 .