Divide and conquer: high-accuracy and real-time 3D reconstruction of static objects using multiple-phase-shifted structured light illumination.

Multiple-phase-shifted structured light illumination achieves high-accuracy 3D reconstructions of static objects, while typically it can't achieve real-time phase computation. In this paper, we propose to compute modulations and phases of multiple scans in real time by using divide-and-conquer solutions. First, we categorize total N = KM images into M groups and each group contains K phase equally shifted images; second, we compute the phase of each group; and finally, we obtain the final phase by averaging all the separately computed phases. When K = 3, 4 or 6, we can use integer-valued intensities of images as inputs and build one or M look-up tables storing real-valued phases computed by using arctangent function. Thus, with addition and/or subtraction operations computing indices of the tables, we can directly access the pre-computed phases and avoid time-consuming arctangent computation. Compared with K-step phase measuring profilometry repeated for M times, the proposed is robust to nonlinear distortion of structured light systems. Experiments show that, first, the proposed is of the same accuracy level as the traditional algorithm, and secondly, with employing one core of a central processing unit, compared with the classical 12-step phase measuring profilometry algorithm, for K = 4 and M = 3, the proposed improves phase computation by a factor of 6 ×.

[1]  Yo-Sung Ho,et al.  Automatic look-up table based real-time phase unwrapping for phase measuring profilometry and optimal reference frequency selection. , 2019, Optics express.

[2]  Qi Hao,et al.  Period Coded Phase Shifting Strategy for Real–time 3-D Structured Light Illumination , 2011, IEEE Transactions on Image Processing.

[3]  Zhongwei Li,et al.  High-speed FPGA-based phase measuring profilometry architecture. , 2017, Optics express.

[4]  Eun-Soo Kim,et al.  Effective memory reduction of the novel look-up table with one-dimensional sub-principle fringe patterns in computer-generated holograms. , 2012, Optics express.

[5]  Zhaoyang Wang,et al.  Real-time, high-accuracy 3D imaging and shape measurement. , 2015, Applied optics.

[6]  Qian Chen,et al.  Graphics processing unit-assisted real-time three-dimensional measurement using speckle-embedded fringe. , 2015, Applied optics.

[7]  Yajun Wang,et al.  3D absolute shape measurement of live rabbit hearts with a superfast two-frequency phase-shifting technique. , 2013, Optics express.

[8]  Xu Xiao,et al.  Reference image based phase unwrapping framework for a structured light system. , 2018, Optics express.

[9]  Xiujuan Zheng,et al.  Reconstructing 3D point clouds in real time with look-up tables for structured light scanning along both horizontal and vertical directions. , 2019, Optics letters.

[10]  Qian Chen,et al.  High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system. , 2019, Optics express.

[11]  Hao Cui,et al.  A rigorous fastener inspection approach for high-speed railway from structured light sensors , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[12]  Sidney Nascimento Givigi,et al.  Vision-Based Measurement for Localization of Objects in 3-D for Robotic Applications , 2015, IEEE Transactions on Instrumentation and Measurement.

[13]  D. Lau,et al.  Gamma model and its analysis for phase measuring profilometry. , 2010, Journal of the Optical Society of America. A, Optics, image science, and vision.

[14]  Qi Hao,et al.  Dual-frequency pattern scheme for high-speed 3-D shape measurement. , 2010, Optics express.

[15]  Eun-Soo Kim,et al.  Effective generation of digital holograms of three-dimensional objects using a novel look-up table method. , 2008, Applied optics.

[16]  Beiwen Li,et al.  Superfast high-resolution absolute 3D recovery of a stabilized flapping flight process. , 2017, Optics express.

[17]  Jae-Sang Hyun,et al.  High-speed and high-accuracy 3D surface measurement using a mechanical projector. , 2018, Optics express.

[18]  Shuisheng Jian,et al.  SMFs With a Ge/F Co-Doped Inner Core for SBS-Based Discriminative Sensing of Temperature and Strain , 2018, IEEE Sensors Journal.

[19]  Qi Hao,et al.  Robust Active Stereo Vision Using Kullback-Leibler Divergence , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Markus Vincze,et al.  A fast stereo matching algorithm suitable for embedded real-time systems , 2010, Comput. Vis. Image Underst..

[21]  Zhiwei Xiong,et al.  FPGA Design and Implementation of Kinect-Like Depth Sensing , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Song Zhang,et al.  High-speed 3D shape measurement with structured light methods: A review , 2018, Optics and Lasers in Engineering.

[23]  Shuming Jiao,et al.  Fast computer generated hologram calculation with a mini look-up table incorporated with radial symmetric interpolation. , 2017, Optics express.

[24]  Anand K. Asundi,et al.  Micro Fourier Transform Profilometry (μFTP): 3D shape measurement at 10, 000 frames per second , 2017, ArXiv.

[25]  Qian Chen,et al.  High-speed three-dimensional profilometry for multiple objects with complex shapes. , 2012, Optics express.

[26]  Qian Chen,et al.  Phase shifting algorithms for fringe projection profilometry: A review , 2018, Optics and Lasers in Engineering.

[27]  Kai Liu,et al.  Real-time three-dimensional shape measurement of moving objects without edge errors by time-synchronized structured illumination. , 2010, Optics letters.

[28]  Sam Van der Jeught,et al.  Real-time structured light profilometry: a review , 2016 .

[29]  Zhoujie Wu,et al.  High-speed three-dimensional shape measurement based on cyclic complementary Gray-code light. , 2019, Optics express.