Three-dimensional surface reconstruction via a robust binary shape-coded structured light method

Abstract. A binary shape-coded structured light method for single-shot three-dimensional reconstruction is presented. The projected structured pattern is composed with eight geometrical shapes with a coding window size of 2×2. The pattern element is designed as rhombic with embedded geometrical shapes. The pattern feature point is defined as the intersection of two adjacent rhombic shapes, and a multitemplate-based feature detector is presented for its robust detection and precise localization. Based on the extracted grid-points, a topological structure is constructed to separate the pattern elements from the obtained image. In the decoding stage, a training dataset is first established from training samples that are collected from a variety of target surfaces. Then, the deep neural network technique is applied for the classification of pattern elements. Finally, an error correction algorithm is introduced based on the epipolar and neighboring constraints to refine the decoding results. The experimental results show that the proposed method not only owns high measurement precision but also has strong robustness to surface color and texture.

[1]  F. MacWilliams,et al.  Pseudo-random sequences and arrays , 1976, Proceedings of the IEEE.

[2]  Kim L. Boyer,et al.  Color-Encoded Structured Light for Rapid Active Ranging , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[4]  Cengizhan Ozturk,et al.  Structured Light Using Pseudorandom Codes , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Joaquim Salvi,et al.  A robust-coded pattern projection for dynamic 3D scene measurement , 1998, Pattern Recognit. Lett..

[6]  Mumin Song,et al.  Overview of three-dimensional shape measurement using optical methods , 2000 .

[7]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Gordon M. Brown,et al.  Guest Editorial: Special Section on Optical Methods for Shape Measurement , 2000 .

[9]  Li Zhang,et al.  Rapid shape acquisition using color structured light and multi-pass dynamic programming , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[10]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[11]  François Blais Review of 20 years of range sensor development , 2004, J. Electronic Imaging.

[12]  Antonio Adán,et al.  3D feature tracking using a dynamic structured light system , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[13]  Richard Szeliski,et al.  Multi-image matching using multi-scale oriented patches , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Pierre Graebling,et al.  Robust Structured Light Coding for 3D Reconstruction , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[15]  Jianwei Zhang,et al.  Vision Processing for Realtime 3-D Data Acquisition Based on Coded Structured Light , 2008, IEEE Transactions on Image Processing.

[16]  Ronald Chung,et al.  Use of LCD Panel for Calibrating Structured-Light-Based Range Sensing System , 2008, IEEE Transactions on Instrumentation and Measurement.

[17]  Peter Eisert,et al.  Adaptive color classification for structured light systems , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[18]  Peter Eisert,et al.  Adaptive colour classification for structured light systems , 2009 .

[19]  Jing Xu,et al.  Real-time 3D shape measurement system based on single structure light pattern , 2010, 2010 IEEE International Conference on Robotics and Automation.

[20]  Dan Zeng,et al.  Model and error analysis for coded structured light measurement system , 2010 .

[21]  Ronald Chung,et al.  Determining Both Surface Position and Orientation in Structured-Light-Based Sensing , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Gabriel Taubin,et al.  Robust one-shot 3D scanning using loopy belief propagation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[23]  Pierre Graebling,et al.  A pattern framework driven by the Hamming distance for structured light-based reconstruction with a single image , 2011, CVPR 2011.

[24]  Antonio Maria Garcia Tommaselli,et al.  A low‐cost 3D reconstruction system using a single‐shot projection of a pattern matrix , 2011 .

[25]  Xu Zhang,et al.  Indirect decoding edges for one-shot shape acquisition. , 2011, Journal of the Optical Society of America. A, Optics, image science, and vision.

[26]  Pierre Graebling,et al.  Epipolar based structured light pattern design for 3-D reconstruction of moving surfaces , 2011, 2011 IEEE International Conference on Robotics and Automation.

[27]  宋展,et al.  Grid Point Extraction and Coding for Structured Light System , 2011 .

[28]  Xu Zhang,et al.  Determination of edge correspondence using color codes for one-shot shape acquisition , 2011 .

[29]  Xu Zhang,et al.  Discontinuity-preserving decoding of one-shot shape acquisition using regularized color , 2012 .

[30]  Xu Zhang,et al.  Color code identification in coded structured light. , 2012, Applied optics.

[31]  Suming Tang,et al.  Fuzzy decoding in color-coded structured light , 2014 .

[32]  Wei Shen,et al.  One-shot monochromatic symbol pattern for 3D reconstruction using perfect submap coding , 2015 .