High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system.

In this paper, we propose a high-speed 3D shape measurement technique based on the optimized composite fringe patterns and stereo-assisted structured light system. Stereo phase unwrapping, as a new-fashioned method for absolute phase retrieval based on the multi-view geometric constraints, can eliminate the phase ambiguities and obtain a continuous phase map without projecting any additional patterns. However, in order to ensure the stability of phase unwrapping, the period of fringe is generally around 20, which limits the accuracy of 3D measurement. To solve this problem, we develop an optimized method for designing the composite pattern, in which the speckle pattern is embedded into the conventional 4-step phase-shifting fringe patterns without compromising the fringe modulation, and thus the phase measurement accuracy. We also present a simple and effective evaluation criterion for the correlation quality of the designed speckle pattern in order to improve the matching accuracy significantly. When the embedded speckle pattern is demodulated, the periodic ambiguities in the wrapped phase can be eliminated by combining the adaptive window image correlation with geometry constraint. Finally, some mismatched regions are further corrected based on the proposed regional diffusion compensation technique (RDC). These proposed techniques constitute a complete computational framework that allows to effectively recover an accurate, unambiguous, and distortion-free 3D point cloud with only 4 projected patterns. Experimental results verify that our method can achieve high-speed, high-accuracy, robust 3D shape measurement with dense (64-period) fringe patterns at 5000 frames per second.

[1]  Zhongwei Li,et al.  Fast phase measurement profilometry for arbitrary shape objects without phase unwrapping , 2013 .

[2]  Qian Chen,et al.  High-speed three-dimensional profilometry for multiple objects with complex shapes. , 2012, Optics express.

[3]  Qian Chen,et al.  High-speed three-dimensional shape measurement using geometry-constraint-based number-theoretical phase unwrapping , 2019, Optics and Lasers in Engineering.

[4]  Qian Chen,et al.  Phase shifting algorithms for fringe projection profilometry: A review , 2018, Optics and Lasers in Engineering.

[5]  G Sansoni,et al.  Three-dimensional vision based on a combination of gray-code and phase-shift light projection: analysis and compensation of the systematic errors. , 1999, Applied optics.

[6]  Song Zhang,et al.  Flexible 3-D shape measurement using projector defocusing. , 2009, Optics letters.

[7]  Qian Chen,et al.  High-precision real-time 3D shape measurement based on a quad-camera system , 2018 .

[8]  Zonghua Zhang,et al.  Review of single-shot 3D shape measurement by phase calculation-based fringe projection techniques , 2012 .

[9]  Avideh Zakhor,et al.  Consistent Stereo-Assisted Absolute Phase Unwrapping Methods for Structured Light Systems , 2012, IEEE Journal of Selected Topics in Signal Processing.

[10]  Thomas J. Flynn,et al.  TWO-DIMENSIONAL PHASE UNWRAPPING WITH MINIMUM WEIGHTED DISCONTINUITY , 1997 .

[11]  Qian Chen,et al.  Real-time 3-D shape measurement with composite phase-shifting fringes and multi-view system. , 2016, Optics express.

[12]  Yunhui Yan,et al.  Fast 3D shape measurement using Fourier transform profilometry without phase unwrapping , 2016 .

[13]  Jae-Sang Hyun,et al.  Pixel-wise absolute phase unwrapping using geometric constraints of structured light system. , 2016, Optics express.

[14]  Qian Chen,et al.  Graphics processing unit-assisted real-time three-dimensional measurement using speckle-embedded fringe. , 2015, Applied optics.

[15]  Anand K. Asundi,et al.  Micro Fourier Transform Profilometry (μFTP): 3D shape measurement at 10, 000 frames per second , 2017, ArXiv.

[16]  Shijie Feng,et al.  High-speed three-dimensional shape measurement for dynamic scenes using bi-frequency tripolar pulse-width-modulation fringe projection , 2013 .

[17]  Louis A. Romero,et al.  Minimum Lp-norm two-dimensional phase unwrapping , 1996 .

[18]  Andreas Tünnermann,et al.  GOBO projection for 3D measurements at highest frame rates: a performance analysis , 2018, Light: Science & Applications.

[19]  Song Zhang,et al.  High-speed 3D shape measurement with structured light methods: A review , 2018, Optics and Lasers in Engineering.

[20]  Song Zhang,et al.  High-speed absolute three-dimensional shape measurement using three binary dithered patterns. , 2014, Optics express.

[21]  Xianyu Su,et al.  Reliability-guided phase unwrapping algorithm: a review ☆ , 2004 .

[22]  Feng Gao,et al.  A simple, flexible and automatic 3D calibration method for a phase calculation-based fringe projection imaging system. , 2013, Optics express.

[23]  Xianyu Su,et al.  Fourier transform profilometry:: a review , 2001 .

[24]  V. Srinivasan,et al.  Automated phase-measuring profilometry of 3-D diffuse objects. , 1984, Applied optics.

[25]  Xiang Peng,et al.  Structured light field 3D imaging. , 2016, Optics express.

[26]  Pei Zhou,et al.  Optical 3-D surface reconstruction with color binary speckle pattern encoding. , 2018, Optics express.

[27]  Yajun Wang,et al.  Novel phase-coding method for absolute phase retrieval. , 2012, Optics letters.

[28]  Qi Hao,et al.  Period Coded Phase Shifting Strategy for Real–time 3-D Structured Light Illumination , 2011, IEEE Transactions on Image Processing.

[29]  Hui Li,et al.  Real-time microscopic 3D shape measurement based on optimized pulse-width-modulation binary fringe projection , 2017 .

[30]  Song Zhang,et al.  Genetic method to optimize binary dithering technique for high-quality fringe generation. , 2013, Optics letters.

[31]  Xiaohui Zhou,et al.  Multiview phase shifting: a full-resolution and high-speed 3D measurement framework for arbitrary shape dynamic objects. , 2013, Optics letters.

[32]  Shijie Feng,et al.  General solution for high dynamic range three-dimensional shape measurement using the fringe projection technique , 2014 .

[33]  Yajun Wang,et al.  Three-dimensional shape measurement with binary dithered patterns. , 2012, Applied optics.

[34]  Jae-Sang Hyun,et al.  High-speed and high-accuracy 3D surface measurement using a mechanical projector. , 2018, Optics express.

[35]  Qican Zhang,et al.  Dynamic 3-D shape measurement method: A review , 2010 .

[36]  Sai Siva Gorthi,et al.  Fringe projection techniques: Whither we are? , 2010 .

[37]  Xiang Peng,et al.  Flexible phase error compensation based on Hilbert transform in phase shifting profilometry. , 2015, Optics express.

[38]  Qian Chen,et al.  Robust dynamic 3-D measurements with motion-compensated phase-shifting profilometry , 2018 .

[39]  Zhiwei Xiong,et al.  Unambiguous 3D measurement from speckle-embedded fringe. , 2013, Applied optics.

[40]  Lei Huang,et al.  Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review , 2016 .

[41]  Qican Zhang,et al.  Quality-guided phase unwrapping technique: comparison of quality maps and guiding strategies. , 2011, Applied optics.

[42]  M. Takeda,et al.  Fourier transform profilometry for the automatic measurement of 3-D object shapes. , 1983, Applied optics.

[43]  Huimin Xie,et al.  Mean intensity gradient: An effective global parameter for quality assessment of the speckle patterns used in digital image correlation , 2010 .

[44]  Qi Hao,et al.  Dual-frequency pattern scheme for high-speed 3-D shape measurement. , 2010, Optics express.

[45]  Zhang Liang,et al.  High dynamic range 3D measurements with fringe projection profilometry: a review , 2018 .

[46]  J. Kofman,et al.  High-frequency background modulation fringe patterns based on a fringe-wavelength geometry-constraint model for 3D surface-shape measurement. , 2017, Optics express.