A single-shot structured light means by encoding both color and geometrical features

Color encoded structured light is an important means for single-shot 3D reconstruction. In this article, we present a pseudorandom array-based structured light method. The proposed pattern is composed with four colors, and one geometric shape is inlaid to the color elements to extend the coding element from four to eight. As a result, a relatively small coding window with the size of 2×2 can be obtained. Grid-point between each two adjacent pattern elements is defined as the pattern feature. And an improved feature detector is proposed for the robust and accurate grid-point localization. The grid-points are divided into two types and represented by a topological structure. The decoding procedure is performed in two steps, the shape decoding and color decoding. Finally, the epipolar constraint and neighboring constraint are introduced to improve the decoding reliability. Accuracy and robustness of the proposed method are evaluated in the experiments. Some real objects including human face are reconstructed to demonstrate the 3D reconstruction quality of the proposed structured light method. Compared with conventional color SL pattern, a novel 'color+geometrical' pattern was proposed.The pattern consists of four colors and one embedded geometrical feature.With a coding capacity of 65×63, a relative small unique window size of 2×2 was obtained.The decoding procedure was implemented as color decoding and geometrical decoding.A robust and accurate pattern feature detection algorithm was also presented.

[1]  Gérard G. Medioni,et al.  Fast Convolution with Laplacian-of-Gaussian Masks , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Pierre Graebling,et al.  A pattern framework driven by the Hamming distance for structured light-based reconstruction with a single image , 2011, CVPR 2011.

[3]  F. MacWilliams,et al.  Pseudo-random sequences and arrays , 1976, Proceedings of the IEEE.

[4]  Jianwei Zhang,et al.  Vision Processing for Realtime 3-D Data Acquisition Based on Coded Structured Light , 2008, IEEE Transactions on Image Processing.

[5]  Cengizhan Ozturk,et al.  Structured Light Using Pseudorandom Codes , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Joaquim Salvi,et al.  ' s personal copy Efficient multiple phase shift patterns for dense 3 D acquisition in structured light scanning , 2010 .

[7]  Ronald Chung,et al.  Determining Both Surface Position and Orientation in Structured-Light-Based Sensing , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Peter Eisert,et al.  Adaptive color classification for structured light systems , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[9]  Gabriel Taubin,et al.  Robust one-shot 3D scanning using loopy belief propagation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[10]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[11]  Ryusuke Sagawa,et al.  Dense one-shot 3D reconstruction by detecting continuous regions with parallel line projection , 2011, 2011 International Conference on Computer Vision.

[12]  Gabriel Taubin,et al.  One-shot scanning using De Bruijn spaced grids , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[13]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[14]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[15]  Michael G. Strintzis,et al.  Real-time acquisition of depth and color images using structured light and its application to 3D face recognition , 2005, Real Time Imaging.

[16]  Joaquim Salvi,et al.  A robust-coded pattern projection for dynamic 3D scene measurement , 1998, Pattern Recognit. Lett..

[17]  Yasushi Yagi,et al.  Grid-Based Active Stereo with Single-Colored Wave Pattern for Dense One-shot 3D Scan , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[18]  Ronald Chung,et al.  Use of LCD Panel for Calibrating Structured-Light-Based Range Sensing System , 2008, IEEE Transactions on Instrumentation and Measurement.

[19]  Tuvi Etzion,et al.  Constructions for perfect maps and pseudorandom arrays , 1988, IEEE Trans. Inf. Theory.

[20]  Shiwei Ma,et al.  A 3D-Shape Reconstruction Method Based on Coded Structured Light and Projected Ray Intersecting Location , 2010, LSMS/ICSEE.

[21]  Yuxiao Hu,et al.  Grid point extraction exploiting point symmetry in a pseudo-random color pattern , 2008, ICIP 2008.

[22]  Paul M. Griffin,et al.  Generation of uniquely encoded light patterns for range data acquisition , 1992, Pattern Recognit..

[23]  Pierre Payeur,et al.  Dense Stereo Range Sensing with Marching Pseudo-Random Patterns , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[24]  André Oosterlinck,et al.  Range Image Acquisition with a Single Binary-Encoded Light Pattern , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  吴海滨 Wu Hai-bin,et al.  Calibration of color coupling and color unbalance in coded structured light system , 2013 .

[26]  Frans Vos,et al.  Some aspects of pseudo random binary array-based surface characterization , 2000, IEEE Trans. Instrum. Meas..

[27]  Fang-Hsuan Cheng,et al.  3D Object Scanning System by Coded Structured Light , 2010, 2010 Third International Symposium on Electronic Commerce and Security.

[28]  Pierre Graebling,et al.  Robust Structured Light Coding for 3D Reconstruction , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[29]  Antonio Adán,et al.  3D feature tracking using a dynamic structured light system , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[30]  Philip Fong,et al.  High-resolution three-dimensional sensing of fast deforming objects , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[32]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..