High-precision real-time 3D shape measurement based on a quad-camera system

Phase-shifting profilometry (PSP) based 3D shape measurement is well established in various applications due to its high accuracy, simple implementation, and robustness to environmental illumination and surface texture. In PSP, higher depth resolution generally requires higher fringe density of projected patterns which, in turn, lead to severe phase ambiguities that must be solved with additional information from phase coding and/or geometric constraints. However, in order to guarantee the reliability of phase unwrapping, available techniques are usually accompanied by increased number of patterns, reduced amplitude of fringe, and complicated post-processing algorithms. In this work, we demonstrate that by using a quad-camera multi-view fringe projection system and carefully arranging the relative spatial positions between the cameras and the projector, it becomes possible to completely eliminate the phase ambiguities in conventional three-step PSP patterns with high-fringe-density without projecting any additional patterns or embedding any auxiliary signals. Benefiting from the position-optimized quad-camera system, stereo phase unwrapping can be efficiently and reliably performed by flexible phase consistency checks. Besides, redundant information of multiple phase consistency checks is fully used through a weighted phase difference scheme to further enhance the reliability of phase unwrapping. This paper explains the 3D measurement principle and the basic design of quad-camera system, and finally demonstrates that in a large measurement volume of 200 mm × 200 mm × 400 mm, the resultant dynamic 3D sensing system can realize real-time 3D reconstruction at 60 frames per second with a depth precision of 50 μm.

[1]  M. Takeda,et al.  Fourier transform profilometry for the automatic measurement of 3-D object shapes. , 1983, Applied optics.

[2]  V. Srinivasan,et al.  Automated phase-measuring profilometry of 3-D diffuse objects. , 1984, Applied optics.

[3]  C. Werner,et al.  Satellite radar interferometry: Two-dimensional phase unwrapping , 1988 .

[4]  Takeo Kanade,et al.  A multiple-baseline stereo , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  J. M. Huntley,et al.  Temporal phase-unwrapping algorithm for automated interferogram analysis. , 1993, Applied optics.

[6]  H Zhao,et al.  Phase-unwrapping algorithm for the measurement of three-dimensional object shapes. , 1994, Applied optics.

[7]  Thomas J. Flynn,et al.  TWO-DIMENSIONAL PHASE UNWRAPPING WITH MINIMUM WEIGHTED DISCONTINUITY , 1997 .

[8]  G Sansoni,et al.  Three-dimensional vision based on a combination of gray-code and phase-shift light projection: analysis and compensation of the systematic errors. , 1999, Applied optics.

[9]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[10]  Munther A Gdeisat,et al.  Fast two-dimensional phase-unwrapping algorithm based on sorting by reliability following a noncontinuous path. , 2002, Applied optics.

[11]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[12]  Luc Van Gool,et al.  Fast 3D Scanning with Automatic Motion Compensation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Song Zhang,et al.  Flexible 3-D shape measurement using projector defocusing. , 2009, Optics letters.

[14]  Qi Hao,et al.  Dual-frequency pattern scheme for high-speed 3-D shape measurement. , 2010, Optics express.

[15]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Qican Zhang,et al.  Dynamic 3-D shape measurement method: A review , 2010 .

[17]  Song Zhang Recent progresses on real-time 3D shape measurement using digital fringe projection techniques , 2010 .

[18]  Song Zhang,et al.  Superfast phase-shifting method for 3-D shape measurement. , 2010, Optics express.

[19]  David P. Towers,et al.  Snapshot color fringe projection for absolute three-dimensional metrology of video sequences , 2010 .

[20]  Sai Siva Gorthi,et al.  Fringe projection techniques: Whither we are? , 2010 .

[21]  Song Zhang,et al.  Superfast multifrequency phase-shifting technique with optimal pulse width modulation. , 2011, Optics express.

[22]  Christian Bräuer-Burchardt,et al.  Using Geometric Constraints to Solve the Point Correspondence Problem in Fringe Projection Based 3D Measuring Systems , 2011, ICIAP.

[23]  Song Zhang,et al.  Phase error compensation for three-dimensional shape measurement with projector defocusing. , 2011, Applied optics.

[24]  Qian Chen,et al.  High-speed three-dimensional profilometry for multiple objects with complex shapes. , 2012, Optics express.

[25]  Avideh Zakhor,et al.  Consistent Stereo-Assisted Absolute Phase Unwrapping Methods for Structured Light Systems , 2012, IEEE Journal of Selected Topics in Signal Processing.

[26]  Zonghua Zhang,et al.  Review of single-shot 3D shape measurement by phase calculation-based fringe projection techniques , 2012 .

[27]  Zhiwei Xiong,et al.  Unambiguous 3D measurement from speckle-embedded fringe. , 2013, Applied optics.

[28]  Shijie Feng,et al.  High-speed three-dimensional shape measurement for dynamic scenes using bi-frequency tripolar pulse-width-modulation fringe projection , 2013 .

[29]  Xiaohui Zhou,et al.  Multiview phase shifting: a full-resolution and high-speed 3D measurement framework for arbitrary shape dynamic objects. , 2013, Optics letters.

[30]  Xiang Peng,et al.  Dynamic 3D imaging based on acousto-optic heterodyne fringe interferometry. , 2014, Optics letters.

[31]  Jiangtao Xi,et al.  Improving the accuracy performance of phase-shifting profilometry for the measurement of objects in motion. , 2014, Optics letters.

[32]  Song Zhang,et al.  High-speed absolute three-dimensional shape measurement using three binary dithered patterns. , 2014, Optics express.

[33]  Shijie Feng,et al.  General solution for high dynamic range three-dimensional shape measurement using the fringe projection technique , 2014 .

[34]  Joachim Denzler,et al.  Phase unwrapping of fringe images for dynamic 3D measurements without additional pattern projection , 2015, Sensing Technologies + Applications.

[35]  Qian Chen,et al.  Real-time 3-D shape measurement with composite phase-shifting fringes and multi-view system. , 2016, Optics express.

[36]  Sam Van der Jeught,et al.  Real-time structured light profilometry: a review , 2016 .

[37]  Lei Huang,et al.  Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review , 2016 .

[38]  Yunhui Yan,et al.  Fast 3D shape measurement using Fourier transform profilometry without phase unwrapping , 2016 .

[39]  Jae-Sang Hyun,et al.  Pixel-wise absolute phase unwrapping using geometric constraints of structured light system. , 2016, Optics express.

[40]  Jiangtao Xi,et al.  Recovery of absolute phases for the fringe patterns of three selected wavelengths with improved anti-error capability , 2016 .

[41]  Qian Chen,et al.  High-precision real-time 3D shape measurement using a bi-frequency scheme and multi-view system. , 2017, Applied optics.

[42]  Anand K. Asundi,et al.  Micro Fourier Transform Profilometry (μFTP): 3D shape measurement at 10, 000 frames per second , 2017, ArXiv.

[43]  Hui Li,et al.  Real-time microscopic 3D shape measurement based on optimized pulse-width-modulation binary fringe projection , 2017 .

[44]  Jonathan Kofman,et al.  Background and amplitude encoded fringe patterns for 3D surface-shape measurement , 2017 .

[45]  Huijie Zhao,et al.  High-speed triangular pattern phase-shifting 3D measurement based on the motion blur method. , 2017, Optics express.