Single-Shot Dense 3D Reconstruction Using Self-Equalizing De Bruijn Sequence

Single-shot dense 3D reconstruction using colored structured light is a difficult problem due to the undesired effects of ambient lighting, object albedo, non-equal channel gains, and channel cross-talk. We propose a novel single-shot dense 3D reconstruction using colored structured light. Our method combines the self-equalizing De Bruijn sequence, scale-space analysis, and bandpass complex Hilbert filters to achieve insensitivity to ambient lighting, object albedo, and non-equal channel gains. The proposed method reconstructs about 85% of points compared to time-multiplexing structured light strategies and the decoding error in the recovered projector coordinate is less than one projector pixel for about 90% of reconstructed points.

[1]  Joseph Shamir,et al.  Range Imaging With Adaptive Color Structured Light , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[3]  David R. Burton,et al.  Spatial and temporal carrier fringe pattern demodulation using the one-dimensional continuous wavelet transform: Recent progress, challenges, and suggested developments , 2009 .

[4]  Horst Schreiber,et al.  Phase Shifting Interferometry , 2006 .

[5]  Jr. S. Marple,et al.  Computing the discrete-time 'analytic' signal via FFT , 1999, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[6]  Xiang Peng,et al.  Surface normal guided method for two-dimensional phase unwrapping , 2002 .

[7]  S. Toyooka,et al.  Automatic profilometry of 3-D diffuse objects by spatial phase detection. , 1986, Applied optics.

[8]  Mitchell M. Tseng,et al.  Model-based digital moiré topography , 1999 .

[9]  Zonghua Zhang,et al.  Review of single-shot 3D shape measurement by phase calculation-based fringe projection techniques , 2012 .

[10]  Peter Eisert,et al.  Adaptive color classification for structured light systems , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[11]  X. Su,et al.  Improved Fourier transform profilometry for the automatic measurement of 3D object shapes , 1990 .

[12]  Y. Y. Hung,et al.  Fast profilometer for the automatic measurement of 3-D object shapes. , 1990, Applied optics.

[13]  Yu Zhou,et al.  Adaptive Color Calibration Based One-Shot Structured Light System , 2012, Sensors.

[14]  David R. Burton,et al.  Spatial carrier fringe pattern demodulation by use of a two-dimensional continuous wavelet transform , 2006 .

[15]  Chris L. Koliopoulos,et al.  Fourier description of digital phase-measuring interferometry , 1990 .

[16]  W. Van Paepegem,et al.  Application of digital phase-shift shadow Moiré to micro deformation measurements of curved surfaces , 2001 .

[17]  M. Takeda,et al.  Fourier transform profilometry for the automatic measurement of 3-D object shapes. , 1983, Applied optics.

[18]  Daniel Malacara Optical Shop Testing (Wiley Series in Pure and Applied Optics) , 2007 .

[19]  Wei-Hung Su,et al.  Projected fringe profilometry using the area-encoded algorithm for spatially isolated and dynamic objects. , 2008, Optics express.

[20]  Aditi Majumder,et al.  Photometric Self-Calibration of a Projector-Camera System , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  R. Rodríguez-Vera,et al.  Phase locked loop profilometry , 1994 .

[22]  Joaquim Salvi,et al.  A robust-coded pattern projection for dynamic 3D scene measurement , 1998, Pattern Recognit. Lett..

[23]  Boualem Boashash,et al.  Analytic signal generation-tips and traps , 1994, IEEE Trans. Signal Process..

[24]  H. Chen,et al.  3-D shape measurement by composite pattern projection and hybrid processing. , 2007, Optics express.

[25]  Tomislav Pribanic,et al.  3D Surface Profilometry Using Phase Shifting of De Bruijn Pattern , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[26]  José A. Gómez-Pedrero,et al.  Algorithm for fringe pattern normalization , 2001 .

[27]  David R. Burton,et al.  Automatic window size selection in Windowed Fourier Transform for 3D reconstruction using adapted mother wavelets , 2011 .

[28]  Lars Kinell Multichannel method for absolute shape measurement using projected fringes , 2004 .

[29]  David W. Capson,et al.  Surface profile measurement using color fringe projection , 1991, Machine Vision and Applications.

[30]  Manuel Servin,et al.  Profilometry for the measurement of 3-D object shapes based on regularized filters , 1999 .

[31]  Christophe Collewet,et al.  Optimised De Bruijn patterns for one-shot shape acquisition , 2005, Image Vis. Comput..

[32]  Daniel Pak-Kong Lun,et al.  Robust Fringe Projection Profilometry via Sparse Representation , 2016, IEEE Transactions on Image Processing.

[33]  Zhiwei Xiong,et al.  Real-Time Scalable Depth Sensing With Hybrid Structured Light Illumination , 2014, IEEE Transactions on Image Processing.

[34]  Carsten Steger,et al.  An Unbiased Detector of Curvilinear Structures , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Joaquim Salvi,et al.  A new optimised De Bruijn coding strategy for structured light patterns , 2004, ICPR 2004.

[36]  Francis Lilley,et al.  The Application of Digital Filtering to Phase Recovery when Surface Contouring using Fringe Projection Techniques , 1997 .

[37]  Xianyu Su,et al.  Fourier transform profilometry:: a review , 2001 .

[38]  Ryo Furukawa,et al.  Dense 3D Reconstruction from High Frame-Rate Video Using a Static Grid Pattern , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Tomislav Pribanic,et al.  The Self-Equalizing De Bruijn Sequence for 3D Profilometry , 2015, BMVC.

[40]  Xianyu Su,et al.  Two-dimensional Fourier transform profilometry for the automatic measurement of three-dimensional object shapes , 1995 .

[41]  David P. Towers,et al.  Snapshot color fringe projection for absolute three-dimensional metrology of video sequences , 2010 .

[42]  Li Zhang,et al.  Rapid shape acquisition using color structured light and multi-pass dynamic programming , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[43]  Mumin Song,et al.  Overview of three-dimensional shape measurement using optical methods , 2000 .

[44]  Joaquim Salvi,et al.  One-shot absolute pattern for dense reconstruction using DeBruijn coding and Windowed Fourier Transform , 2013 .

[45]  Lin Chi-Fang,et al.  A new approach to high precision 3-D measuring system , 1999 .

[46]  Gabriel Taubin,et al.  Simple, Accurate, and Robust Projector-Camera Calibration , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[47]  Kurt Konolige,et al.  Projected texture stereo , 2010, 2010 IEEE International Conference on Robotics and Automation.

[48]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[49]  Qian Kemao,et al.  Two-dimensional windowed Fourier transform for fringe pattern analysis: Principles, applications and implementations , 2007 .

[50]  J. Wyant,et al.  Optical Metrology of Diffuse Surfaces , 2006 .