Large depth-of-field 3D shape measurement using an electrically tunable lens.

The state-of-the-art 3D shape measurement system has rather shallow working volume due to the limited depth-of-field (DOF) of conventional lens. In this paper, we propose to use the electrically tunable lens to substantially enlarge the DOF. Specifically, we capture always in-focus phase-shifted fringe patterns by precisely synchronizing the tunable lens attached to the camera with the image acquisition and the pattern projection; we develop a phase unwrapping framework that fully utilizes the geometric constraint from the camera focal length setting; and we pre-calibrate the system under different focal distance to reconstruct 3D shape from unwrapped phase map. To validate the proposed idea, we developed a prototype system that can perform high-quality measurement for the depth range of approximately 1,000 mm (400 mm - 1400 mm) with the measurement error of 0.05%. Furthermore, we demonstrated that such a technique can be used for real-time 3D shape measurement by experimentally measuring moving objects.

[1]  Murali Subbarao,et al.  Depth from defocus: A spatial domain approach , 1994, International Journal of Computer Vision.

[2]  V Aslantas,et al.  Depth from automatic defocusing. , 2007, Optics express.

[3]  B. Berge,et al.  Variable focal lens controlled by an external voltage: An application of electrowetting , 2000 .

[4]  Huazhong Yang,et al.  All-in-focus with directional-max-gradient flow and labeled iterative depth propagation , 2018, Pattern Recognit..

[5]  Yi-Hsin Lin,et al.  A Review of Electrically Tunable Focusing Liquid Crystal Lenses , 2011 .

[6]  Gastón A Ayubi,et al.  All-in-focus image reconstruction under severe defocus. , 2015, Optics letters.

[7]  Patricia Ladret,et al.  The blur effect: perception and estimation with a new no-reference perceptual blur metric , 2007, Electronic Imaging.

[8]  David Andelman,et al.  , electricity, and between… On electrowetting and its applications. , 2007, Soft matter.

[9]  Shree K. Nayar,et al.  Projection defocus analysis for scene capture and image display , 2006, SIGGRAPH 2006.

[10]  Beiwen Li,et al.  Novel calibration method for structured-light system with an out-of-focus projector. , 2014, Applied optics.

[11]  Jae-Sang Hyun,et al.  Enhanced two-frequency phase-shifting method. , 2016, Applied optics.

[12]  Qian Chen,et al.  Improved intensity-optimized dithering technique for 3D shape measurement , 2015 .

[13]  Shang-Hong Lai,et al.  A Generalized Depth Estimation Algorithm with a Single Image , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Jae-Sang Hyun,et al.  Pixel-wise absolute phase unwrapping using geometric constraints of structured light system. , 2016, Optics express.

[15]  Yajun Wang,et al.  Three-dimensional shape measurement with binary dithered patterns. , 2012, Applied optics.

[16]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, SIGGRAPH 2007.

[17]  Zhiwei Xiong,et al.  Robust depth sensing with adaptive structured light illumination , 2014, J. Vis. Commun. Image Represent..

[18]  Ken Chen,et al.  Depth-driven variable-frequency sinusoidal fringe pattern for accuracy improvement in fringe projection profilometry. , 2018, Optics express.