Pixel-wise parallel calculation for depth from focus with adaptive focus measure

Depth-from-focus methods can estimate the depth from a set of images taken with different focus settings. We recently proposed a method that uses the relationship of the ratio between the luminance value of a target pixel and the mean value of the neighboring pixels. This relationship has a Poisson distribution. Despite its good performance, the method requires a large amount of memory and computation time because it needs to store focus measurement values for each depth and each window radius on a pixel-wise basis, and filtering to compute the mean value, which is performed twice, makes the relationship among neighboring pixels too strong to parallelize the pixel-wise processing. In this paper, we propose an approximate calculation method that can give almost the same results with a single time filtering operation and enables pixel-wise parallelization. This pixel-wise processing does not require the aforementioned focus measure values to be stored, which reduces the amount of memory. Additionally, utilizing the pixel-wise processing, we propose a method of determining the process window size that can improve noise tolerance and in depth estimation in texture-less regions. Through experiments, we show that our new method can better estimate depth values in a much shorter time.

[1]  Nahum Kiryati,et al.  Shape from Focus with Adaptive Focus Measure and High Order Derivatives , 2015, BMVC.

[2]  Krzysztof S. Berezowski,et al.  Efficiency Analysis of the Autofocusing Algorithm Based on Orthogonal Transforms , 2013 .

[3]  Eric Krotkov,et al.  Focusing , 2004, International Journal of Computer Vision.

[4]  Bradley J. Nelson,et al.  Wavelet-based autofocusing and unsupervised segmentation of microscopic images , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[5]  Tae-Sun Choi,et al.  Application of Three Dimensional Shape from Image Focus in LCD/TFT Displays Manufacturing , 2007, IEEE Transactions on Consumer Electronics.

[6]  Y. Blanter,et al.  Shot noise in mesoscopic conductors , 1999, cond-mat/9910158.

[7]  Jong-An Park,et al.  Shape from Focus through Laplacian Using 3D Window , 2008, 2008 Second International Conference on Future Generation Communication and Networking.

[8]  Michael Möller,et al.  Variational Depth From Focus Reconstruction , 2014, IEEE Transactions on Image Processing.

[9]  Shree K. Nayar,et al.  Shape from focus: an effective approach for rough surfaces , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[10]  Lining Sun,et al.  Wavelet-Based Focus Measure and 3-D Surface Reconstruction Method for Microscopy Images , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Domenec Puig,et al.  Analysis of focus measure operators for shape-from-focus , 2013, Pattern Recognit..

[12]  Andrea Thelen,et al.  Improvements in Shape-From-Focus for Holographic Reconstructions With Regard to Focus Operators, Neighborhood-Size, and Height Value Interpolation , 2009, IEEE Transactions on Image Processing.

[13]  Jan Flusser,et al.  A new wavelet-based measure of image focus , 2002, Pattern Recognit. Lett..

[14]  Tae-Sun Choi,et al.  Consideration of illumination effects and optimization of window size for accurate calculation of depth map for 3D shape recovery , 2007, Pattern Recognit..