Generation of All-in-Focus Images by Noise-Robust Selective Fusion of Limited Depth-of-Field Images

The limited depth-of-field of some cameras prevents them from capturing perfectly focused images when the imaged scene covers a large distance range. In order to compensate for this problem, image fusion has been exploited for combining images captured with different camera settings, thus yielding a higher quality all-in-focus image. Since most current approaches for image fusion rely on maximizing the spatial frequency of the composed image, the fusion process is sensitive to noise. In this paper, a new algorithm for computing the all-in-focus image from a sequence of images captured with a low depth-of-field camera is presented. The proposed approach adaptively fuses the different frames of the focus sequence in order to reduce noise while preserving image features. The algorithm consists of three stages: 1) focus measure; 2) selectivity measure; 3) and image fusion. An extensive set of experimental tests has been carried out in order to compare the proposed algorithm with state-of-the-art all-in-focus methods using both synthetic and real sequences. The obtained results show the advantages of the proposed scheme even for high levels of noise.

[1]  Bradley J Nelson,et al.  Autofocusing in computer microscopy: Selecting the optimal focus algorithm , 2004, Microscopy research and technique.

[2]  Jing Tian,et al.  Multi-focus image fusion using wavelet-domain statistics , 2010, 2010 IEEE International Conference on Image Processing.

[3]  Dimitri Van De Ville,et al.  Model-Based 2.5-D Deconvolution for Extended Depth of Field in Brightfield Microscopy , 2008, IEEE Transactions on Image Processing.

[4]  Muralidhara Subbarao,et al.  Selecting the Optimal Focus Measure for Autofocusing and Depth-From-Focus , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Yong-Moo Kwon,et al.  Implementation of a passive automatic focusing algorithm for digital still camera , 1995 .

[6]  Li Chen,et al.  Multi-focus image fusion using a bilateral gradient-based sharpness criterion , 2011 .

[7]  Homer H. Chen,et al.  Reciprocal Focus Profile , 2012, IEEE Transactions on Image Processing.

[8]  A G Valdecasas,et al.  On the extended depth of focus algorithms for bright field microscopy. , 2001, Micron.

[9]  E. Wolf,et al.  Principles of Optics (7th Ed) , 1999 .

[10]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[11]  Tae-Sun Choi,et al.  Consideration of illumination effects and optimization of window size for accurate calculation of depth map for 3D shape recovery , 2007, Pattern Recognit..

[12]  Michael Unser,et al.  Complex wavelets for extended depth‐of‐field: A new method for the fusion of multichannel microscopy images , 2004, Microscopy research and technique.

[13]  Kazuya Kodama,et al.  Simple and Fast All-in-Focus Image Reconstruction Based on Three-Dimensional/Two-Dimensional Transform and Filtering , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[14]  Rick S. Blum,et al.  A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application , 1999, Proc. IEEE.

[15]  George Wolberg,et al.  Digital image warping , 1990 .

[16]  Muralidhara Subbarao,et al.  Accurate Recovery of Three-Dimensional Shape from Image Focus , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Yaonan Wang,et al.  Combination of images with diverse focuses using the spatial frequency , 2001, Inf. Fusion.

[18]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  A. T. Basokur,et al.  Digital filter design using the hyperbolic tangent functions 1 , 1998 .

[20]  D. Malacara-Hernández,et al.  PRINCIPLES OF OPTICS , 2011 .

[21]  Tae-Sun Choi,et al.  Sampling for Shape from Focus in Optical Microscopy , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Richard Szeliski,et al.  Automatic Estimation and Removal of Noise from a Single Image , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Gabriel Thomas,et al.  All-in-Focus Imaging Using a Series of Images on Different Focal Planes , 2005, ICIAR.

[24]  Veysel Aslantas,et al.  A comparison of criterion functions for fusion of multi-focus noisy images , 2009 .

[25]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Tae-Sun Choi,et al.  Focusing techniques , 1992, Other Conferences.