Interference-Free Epipole-Centered Structured Light Pattern for Mirror-Based Multi-view Active Stereo

This paper is aimed at proposing a new structured light pattern for mirror-based multi-view active stereo so that the patterns cast onto the object surface do not interfere even where the object is illuminated by the projector directly and indirectly via mirror. The key idea of our interference-free projection is to encode the projector pixel locations so that they do not collide with the code from other projector pixels by exploiting the epipolar geometry defined by the real and the virtual projectors. We prove that our new encoding does not generate code collisions between the direct and indirect patterns from the real and the virtual projectors respectively. Evaluations using real and synthesized datasets demonstrate that our approach can realize an interference-free projection without using specialized equipment such as orthographic projectors used in the state-of-the-art methods.

[1]  Dong Hoon Lee,et al.  A moving planar mirror based approach for cultural reconstruction , 2004, Comput. Animat. Virtual Worlds.

[2]  Richard Szeliski,et al.  Building Rome in a day , 2009, ICCV.

[3]  Douglas Lanman,et al.  Surround structured lighting: 3-D scanning with orthographic illumination , 2009, Comput. Vis. Image Underst..

[4]  Hans-Peter Seidel,et al.  Time-resolved 3d capture of non-stationary gas flows , 2008, SIGGRAPH 2008.

[5]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[6]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Wolfgang Heidrich,et al.  Stochastic tomography and its applications in 3D imaging of mixing fluids , 2012, ACM Trans. Graph..

[8]  Michal Havlena,et al.  Efficient Structure from Motion by Graph Optimization , 2010, ECCV.

[9]  Kiriakos N. Kutulakos,et al.  Dynamic Refraction Stereo , 2005, ICCV.

[10]  Takeo Kanade,et al.  Projector Calibration using Arbitrary Planes and Calibrated Camera , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Yasushi Yagi,et al.  Grid-Based Active Stereo with Single-Colored Wave Pattern for Dense One-shot 3D Scan , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[12]  Andrew W. Fitzgibbon,et al.  Automatic 3D Model Construction for Turn-Table Sequences , 1998, SMILE.

[13]  Atsushi Nakazawa,et al.  The Great Buddha Project: Digitally Archiving, Restoring, and Analyzing Cultural Heritage Objects , 2007, International Journal of Computer Vision.

[14]  Gabriel Taubin,et al.  Simple, Accurate, and Robust Projector-Camera Calibration , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[15]  Daniel Cremers,et al.  Multiview Stereo and Silhouette Consistency via Convex Functionals over Convex Domains , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Adrian Hilton,et al.  Volumetric Stereo with Silhouette and Feature Constraints , 2006, BMVC.

[17]  Jonathan T. Barron,et al.  3D self-portraits , 2013, ACM Trans. Graph..

[18]  Roberto Cipolla,et al.  Multiview Stereo via Volumetric Graph-Cuts and Occlusion Robust Photo-Consistency , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Roberto Cipolla,et al.  Multiview Photometric Stereo , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Savarese,et al.  D depth recovery with grayscale structured lighting S � , 2003 .

[21]  Takashi Matsuyama,et al.  Complete multi-view reconstruction of dynamic scenes from probabilistic fusion of narrow and wide baseline stereo , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[22]  Jovan Popović,et al.  Dynamic shape capture using multi-view photometric stereo , 2009, SIGGRAPH 2009.

[23]  Slobodan Ilic,et al.  Free-form mesh tracking: A patch-based approach , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Reinhard Koch,et al.  Hand-held acquisition of 3D models with a video camera , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[25]  Björn Stenger,et al.  Video Normals from Colored Lights , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Takeo Kanade,et al.  Simultaneous self-calibration of a projector and a camera using structured light , 2011, CVPR 2011 WORKSHOPS.

[27]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Keith Forbes,et al.  Shape-from-Silhouette with Two Mirrors and an Uncalibrated Camera , 2006, ECCV.

[29]  Hans-Peter Seidel,et al.  Motion capture using joint skeleton tracking and surface estimation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.