A nonlinear Transform Based Three-Dimensional Shape Recovery from Image Focus

The use of intelligent and sophisticated approaches in the domain of computer vision and pattern recognition is consistently increasing. This paper introduces a novel machine learning based approach for Shape From Focus (SFF), where the in-focus pixels are selected from a sequence of images. In contrast to computing focus values directly in spatial or transform domain, the proposed method first nonlinearly transforms the input space into feature space and then computes the focus value by transforming the data into eigenspace. First, the nonlinear transformation is performed by using kernel function and then Principal Component Analysis (PCA) is applied. This idea is also supported by the fact that out-of-focus is analogous to blurring and is a nonlinear phenomenon. An initial depth map is computed by maximizing the focus measure. To further refine the 3D shape, bilateral filter is applied. The proposed method is experimented using synthetic and real image sequences. The results demonstrate the effectiveness and the robustness of the new method.

[1]  Tae-Sun Choi,et al.  Three-dimensional shape recovery from focused image surface , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[2]  Sang-Woong Lee,et al.  Noniterative 3D Face Reconstruction Based on Photometric Stereo , 2008, Int. J. Pattern Recognit. Artif. Intell..

[3]  Lining Sun,et al.  Construction and evaluation of a wavelet‐based focus measure for microscopy imaging , 2007, Microscopy research and technique.

[4]  Homer H. Chen,et al.  Robust focus measure for low-contrast images , 2006, 2006 Digest of Technical Papers International Conference on Consumer Electronics.

[5]  Mal-Rey Lee 3D Shape Reconstruction of Hybrid Reflectance Using the LMS Algorithm , 2001, Int. J. Pattern Recognit. Artif. Intell..

[6]  Muralidhara Subbarao,et al.  Accurate Recovery of Three-Dimensional Shape from Image Focus , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Tae-Sun Choi,et al.  Application of Three Dimensional Shape from Image Focus in LCD/TFT Displays Manufacturing , 2007, IEEE Transactions on Consumer Electronics.

[9]  Xuelong Li,et al.  Recovery of Nonrigid Structures from 2D Observations , 2008, Int. J. Pattern Recognit. Artif. Intell..

[10]  Matej Kristan,et al.  A Bayes-spectral-entropy-based measure of camera focus using a discrete cosine transform , 2006, Pattern Recognit. Lett..

[11]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[12]  Bradley J Nelson,et al.  Autofocusing in computer microscopy: Selecting the optimal focus algorithm , 2004, Microscopy research and technique.

[13]  Young Gil Kim,et al.  Face recognition using a fusion method based on bidirectional 2DPCA , 2008, Appl. Math. Comput..

[14]  Tae-Sun Choi,et al.  A heuristic approach for finding best focused shape , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Tae-Sun Choi,et al.  Shape from focus using multilayer feedforward neural networks , 2000, IEEE Trans. Image Process..

[16]  Jay Martin Tenenbaum,et al.  Accommodation in computer vision , 1971 .