Robust Dense Depth Acquisition Using 2-D De Bruijn Structured Light

We present a new dense depth acquisition method using 2-D De Bruijn structured light, which is robust to various textures and is able to reconstruct dense depth maps of moving and deforming objects. A 2-D binary De Bruijn pattern is emitted to the target object by an off-the-shelf projector. Fast dynamic programming based stereo matching is performed on images taken from two different views. The depth is obtained by robust least square triangulation. The advantages include that we do not need to take image sequences with different illumination patterns and do not assume that the surface for reconstruction has uniform texture. Experimental results show that shapes can be efficiently obtained in good quality by the proposed approach. We believe that our approach is a good choice in applications of acquiring depth maps for moving scenes with inexpensive equipments.

[1]  Cengizhan Ozturk,et al.  Structured Light Using Pseudorandom Codes , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[3]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[4]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[5]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[6]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[7]  Dan Ionescu,et al.  3D object model recovery from 2D images using structured light , 2004, IEEE Transactions on Instrumentation and Measurement.

[8]  Joaquim Salvi,et al.  A new optimised De Bruijn coding strategy for structured light patterns , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[9]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  O. Faugeras,et al.  Camera Self-Calibration from Video Sequences: the Kruppa Equations Revisited , 1996 .

[11]  William H. Press,et al.  Numerical Recipes in FORTRAN - The Art of Scientific Computing, 2nd Edition , 1987 .

[12]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[13]  William H. Press,et al.  Numerical recipes in C (2nd ed.): the art of scientific computing , 1992 .

[14]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[15]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .

[16]  Charles T. Loop,et al.  Computing rectifying homographies for stereo vision , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[17]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Dan Ionescu,et al.  3-D object model recovery from 2-D images using structured light , 1996, Quality Measurement: The Indispensable Bridge between Theory and Reality (No Measurements? No Science! Joint Conference - 1996: IEEE Instrumentation and Measurement Technology Conference and IMEKO Tec.

[19]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Ingemar J. Cox,et al.  A Maximum Likelihood Stereo Algorithm , 1996, Comput. Vis. Image Underst..