Three-dimensional reconstruction with single-shot structured light dot pattern and analytic solutions

Abstract Structured light three-dimensional reconstruction is one of the most important techniques in computer vision. However, most existing methods require multiple projections of the designed patterns to achieve the closed form solution, which makes them fail to measure the dynamic objects. In this paper, we propose a two-view based single-shot structured light 3D reconstruction approach that calculates the 3D coordinates of the object with analytical solutions. The designed structured light dot pattern is projected onto the object, distorted and imaged in two cameras. For each point in the structured light dot pattern, there is a ray of light that goes through the optical center and the physically imaged point on the camera’s image plane. Two rays could be determined by two cameras and their intersection solves the unknown point on the object in the 3D world coordinate system. To segment the dot pattern robustly and efficiently, an iterative dot segmentation method is proposed. Experimental results verified the effectiveness of the proposed approach in reconstructing objects without bright colors, rich textures, large discontinuities and obvious occlusions.

[1]  Henrique Lorenzo,et al.  Metrological evaluation of KinectFusion and its comparison with Microsoft Kinect sensor , 2015 .

[2]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Xianyu Su,et al.  Fourier transform profilometry:: a review , 2001 .

[4]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[5]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[6]  Sang Wook Lee,et al.  Structured-light stereo: Comparative analysis and integration of structured-light and active stereo , 2013 .

[7]  José A. Ferrari,et al.  One-shot 3D scanning by combining sparse landmarks with dense gradient information , 2018, Optics and Lasers in Engineering.

[8]  S. Foix,et al.  Lock-in Time-of-Flight (ToF) Cameras: A Survey , 2011, IEEE Sensors Journal.

[9]  K. Creath V Phase-Measurement Interferometry Techniques , 1988 .

[10]  Yasushi Yagi,et al.  Dynamic scene shape reconstruction using a single structured light pattern , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Pedro Arias,et al.  Metrological comparison between Kinect I and Kinect II sensors , 2015 .

[12]  Jason Geng,et al.  Structured-light 3D surface imaging: a tutorial , 2011 .

[13]  Zhenzhou Wang,et al.  Robust three-dimensional face reconstruction by one-shot structured light line pattern , 2020 .

[14]  Meena Mahajan,et al.  The Planar k-means Problem is NP-hard I , 2009 .

[15]  Zhenzhou Wang,et al.  Three-Dimensional Hand Reconstruction by Single-Shot Structured Light Line Pattern , 2018, IEEE Access.

[16]  Dah-Jye Lee,et al.  Review of stereo vision algorithms and their suitability for resource-limited systems , 2013, Journal of Real-Time Image Processing.

[17]  Beiwen Li,et al.  Motion-induced error reduction by combining Fourier transform profilometry with phase-shifting profilometry. , 2016, Optics express.

[18]  Florian Willomitzer,et al.  Single-shot 3D motion picture camera with a dense point cloud. , 2017, Optics express.

[19]  Jingjing Xiong,et al.  A Flexible and Robust Threshold Selection Method , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  M. Takeda,et al.  Fourier transform profilometry for the automatic measurement of 3-D object shapes. , 1983, Applied optics.

[21]  Ryusuke Sagawa,et al.  Dense one-shot 3D reconstruction by detecting continuous regions with parallel line projection , 2011, 2011 International Conference on Computer Vision.

[22]  Song Zhang,et al.  High-resolution, real-time 3D absolute coordinate measurement based on a phase-shifting method. , 2006, Optics express.

[23]  Fulvio Rinaudo,et al.  SR-4000 and CamCube3.0 Time of Flight (ToF) Cameras: Tests and Comparison , 2012, Remote. Sens..

[24]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Zhenzhou Wang A one-shot-projection method for measurement of specular surfaces. , 2015, Optics express.

[26]  ZhenZhou Wang,et al.  Single-shot three-dimensional reconstruction based on structured light line pattern , 2018, Optics and Lasers in Engineering.

[27]  Szymon Rusinkiewicz,et al.  Spacetime Stereo: A Unifying Framework for Depth from Triangulation , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Hubert P. H. Shum,et al.  Real-Time Posture Reconstruction for Microsoft Kinect , 2013, IEEE Transactions on Cybernetics.

[29]  Elise Lachat,et al.  Assessment and Calibration of a RGB-D Camera (Kinect v2 Sensor) Towards a Potential Use for Close-Range 3D Modeling , 2015, Remote. Sens..