Multi-projector color structured-light vision

Research interest in rapid structured-light imaging has grown increasingly for the modeling of moving objects, and a number of methods have been suggested for the range capture in a single video frame. The imaging area of a 3D object using a single projector is restricted since the structured light is projected only onto a limited area of the object surface. Employing additional projectors to broaden the imaging area is a challenging problem since simultaneous projection of multiple patterns results in their superposition in the light-intersected areas and the recognition of original patterns is by no means trivial. This paper presents a novel method of multi-projector color structured-light vision based on projector-camera triangulation. By analyzing the behavior of superposed-light colors in a chromaticity domain, we show that the original light colors cannot be properly extracted by the conventional direct estimation. We disambiguate multiple projectors by multiplexing the orientations of projector patterns so that the superposed patterns can be separated by explicit derivative computations. Experimental studies are carried out to demonstrate the validity of the presented method. The proposed method increases the efficiency of range acquisition compared to conventional active stereo using multiple projectors.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Mark S. Nixon,et al.  A Hough transform for detecting the location and orientation of three-dimensional surfaces via color encoded spots , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[3]  Nahum Kiryati,et al.  Toward optimal structured light patterns , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[4]  Sang Wook Lee,et al.  Color-Stripe Structured Light Robust to Surface Color and Discontinuity , 2007, ACCV.

[5]  Robert A. Hummel,et al.  Experiments with the intensity ratio depth sensor , 1985, Comput. Vis. Graph. Image Process..

[6]  Adrian Hilton,et al.  Video-rate capture of dynamic face shape and appearance , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[7]  Joseph Shamir,et al.  Range Imaging With Adaptive Color Structured Light , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[9]  Yasushi Yagi,et al.  One-shot Entire Shape Acquisition Method Using Multiple Projectors and Cameras , 2010, 2010 Fourth Pacific-Rim Symposium on Image and Video Technology.

[10]  Bo Sun,et al.  Structured light in scattering media , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[11]  Peter Eisert,et al.  Adaptive colour classification for structured light systems , 2009 .

[12]  Johji Tajima,et al.  3-D data acquisition by Rainbow Range Finder , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[13]  Kim L. Boyer,et al.  Color-Encoded Structured Light for Rapid Active Ranging , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Sang Wook Lee,et al.  Color-Phase Analysis for Sinusoidal Structured Light in Rapid Range Imaging , 2015, ArXiv.

[15]  Li Zhang,et al.  Rapid shape acquisition using color structured light and multi-pass dynamic programming , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[16]  Sang Wook Lee,et al.  Structured-light stereo: Comparative analysis and integration of structured-light and active stereo , 2013 .

[17]  Li Zhang,et al.  Spacetime faces: high resolution capture for modeling and animation , 2004, SIGGRAPH 2004.

[18]  Luc Van Gool,et al.  Real-time range acquisition by adaptive structured light , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Marc Levoy,et al.  Better optical triangulation through spacetime analysis , 1995, Proceedings of IEEE International Conference on Computer Vision.

[20]  Li Zhang,et al.  Spacetime stereo: shape recovery for dynamic scenes , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[21]  Ja-Ling Wu,et al.  Range data acquisition using color structured lighting and stereo vision , 1997, Image Vis. Comput..

[22]  Marc Rioux,et al.  Design Of A Large Depth Of View Three-Dimensional Camera For Robot Vision , 1987 .

[23]  Pierre Graebling,et al.  Robust Structured Light Coding for 3D Reconstruction , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[24]  Luc Van Gool,et al.  Scene-adapted structured light , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  Yasushi Yagi,et al.  Dynamic scene shape reconstruction using a single structured light pattern , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Sang Wook Lee,et al.  Colour-Stripe Permutation Pattern for Rapid Structured-Light Range Imaging , 2012 .

[27]  Yasushi Yagi,et al.  Dense 3D reconstruction method using a single pattern for fast moving object , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[28]  Szymon Rusinkiewicz,et al.  Stripe boundary codes for real-time structured-light range scanning of moving objects , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[29]  Christophe Collewet,et al.  Optimised De Bruijn patterns for one-shot shape acquisition , 2005, Image Vis. Comput..

[30]  Sang Wook Lee,et al.  High-Contrast Color-Stripe Pattern for Rapid Structured-Light Range Imaging , 2004, ECCV.

[31]  S. Inokuchi,et al.  Three-dimensional surface measurement by space encoding range imaging , 1985 .

[32]  Fu-Pen Chiang,et al.  Color-encoded digital fringe projection technique for high-speed three-dimensional surface contouring , 1999 .