Real-time range acquisition by adaptive structured light

The goal of this paper is to provide a "self-adaptive" system for real-time range acquisition. Reconstructions are based on a single frame structured light illumination. Instead of using generic, static coding that is supposed to work under all circumstances, system adaptation is proposed. This occurs on-the-fly and renders the system more robust against instant scene variability and creates suitable patterns at startup. A continuous trade-off between speed and quality is made. A weighted combination of different coding cues - based upon pattern color, geometry, and tracking - yields a robust way to solve the correspondence problem. The individual coding cues are automatically adapted within a considered family of patterns. The weights to combine them are based on the average consistency with the result within a small time-window. The integration itself is done by reformulating the problem as a graph cut. Also, the camera-projector configuration is taken into account for generating the projection patterns. The correctness of the range maps is not guaranteed, but an estimation of the uncertainty is provided for each part of the reconstruction. Our prototype is implemented using unmodified consumer hardware only and, therefore, is cheap. Frame rates vary between 10 and 25 fps, dependent on scene complexity.

[1]  J. T. Dijak,et al.  Robot Vision by Encoded Light Beams , 1987 .

[2]  Kim L. Boyer,et al.  Color-Encoded Structured Light for Rapid Active Ranging , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Minoru Maruyama,et al.  Range Sensing By Projecting Multiple Slits With Random Cuts , 1990, Other Conferences.

[4]  André Oosterlinck,et al.  Range Image Acquisition with a Single Binary-Encoded Light Pattern , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Paul M. Griffin,et al.  Generation of uniquely encoded light patterns for range data acquisition , 1992, Pattern Recognit..

[6]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[7]  Nahum Kiryati,et al.  Toward optimal structured light patterns , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[8]  Luc Van Gool,et al.  One-shot active 3D image capture , 1997, Electronic Imaging.

[9]  Joaquim Salvi,et al.  Recent progress in coded structured light as a technique to solve the correspondence problem: a survey , 1998, Pattern Recognit..

[10]  Joseph Shamir,et al.  Range Imaging With Adaptive Color Structured Light , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Luc Van Gool,et al.  Efficient, Active 3D Acquisition, Based on a Pattern-Specific Snake , 2002, DAGM-Symposium.

[12]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[13]  Joaquim Salvi,et al.  A review of laser scanning three-dimensional digitisers , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Li Zhang,et al.  Rapid shape acquisition using color structured light and multi-pass dynamic programming , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[15]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[16]  Thomas P. Koninckx,et al.  High-speed active 3D acquisition based on a pattern-specific mesh , 2003, IS&T/SPIE Electronic Imaging.

[17]  Luc Van Gool,et al.  Online 3D acquisition and model integration , 2003 .

[18]  Luc Van Gool,et al.  Real-time range scanning of deformable surfaces by adaptively coded structured light , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[19]  Guy Godin,et al.  Recursive model optimization using ICP and free moving 3D data acquisition , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[20]  Manuel Menezes de Oliveira Neto,et al.  A point-and-shoot color 3D camera , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[21]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Steven M. Seitz,et al.  Spacetime faces , 2004, ACM Trans. Graph..

[23]  Sang Wook Lee,et al.  High-Contrast Color-Stripe Pattern for Rapid Structured-Light Range Imaging , 2004, ECCV.

[24]  François Blais.  Review of 20 years of range sensor development , 2004, J. Electronic Imaging.

[25]  Thomas Koninckx,et al.  Adaptive Structured Light (Adaptief gestructureerd licht) , 2005 .