One-Shot Entire Shape Scanning by Utilizing Multiple Projector-Camera Constraints of Grid Patterns

This paper proposes a method to reconstruct the entire shape of moving objects by using multiple cameras and projectors. The projectors simultaneously cast static grid patterns of wave lines. Each of the projected patterns is a single-colored pattern of either red, green, or blue. Those patterns can be decomposed stably, compared to multi-colored patterns. For the 3D reconstruction algorithm, one shot reconstruction with wave grid pattern is extended for entire-shape acquisition, so that the correspondences between the adjacent devices can be used as additional constraints to reduce shape errors. Finally, multiple shapes obtained from the different views are merged into a single polygon mesh model using estimated normal information for each vertex.

[1]  Takeo Kanade,et al.  A real time system for robust 3D voxel reconstruction of human motions , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[2]  Hans-Peter Seidel,et al.  Motion capture using joint skeleton tracking and surface estimation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Qionghai Dai,et al.  Fusing Multiview and Photometric Stereo for 3D Reconstruction under Uncalibrated Illumination , 2011, IEEE Transactions on Visualization and Computer Graphics.

[4]  Yasushi Makihara,et al.  Dynamic scene reconstruction using asynchronous multiple Kinects , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[5]  Johji Tajima,et al.  3-D data acquisition by Rainbow Range Finder , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[6]  Song Zhang,et al.  High-Resolution, Real-time 3D Shape Acquisition , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[7]  Daniel P. Huttenlocher,et al.  Efficient Belief Propagation for Early Vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[8]  Gabriel Taubin,et al.  One-shot scanning using De Bruijn spaced grids , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[9]  Jovan Popović,et al.  Dynamic shape capture using multi-view photometric stereo , 2009, SIGGRAPH 2009.

[10]  Yasushi Yagi,et al.  Entire Shape Acquisition Technique Using Multiple Projectors and Cameras with Parallel Pattern Projection , 2012, IPSJ Trans. Comput. Vis. Appl..

[11]  K. Nechvíle.  The High Resolution , 2005 .

[12]  Yasushi Yagi,et al.  Dynamic scene shape reconstruction using a single structured light pattern , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Yasushi Yagi,et al.  Dense 3D reconstruction method using a single pattern for fast moving object , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[14]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[15]  Young Min Kim,et al.  Design and calibration of a multi-view TOF sensor fusion system , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[16]  Xiaojun Wu,et al.  Real-time 3D shape reconstruction, dynamic 3D mesh deformation, and high fidelity visualization for 3D video , 2004, Comput. Vis. Image Underst..

[17]  Nozomu Kasuya,et al.  Robust and Accurate One-Shot 3D Reconstruction by 2C1P System with Wave Grid Pattern , 2013, 2013 International Conference on 3D Vision.

[18]  F FelzenszwalbPedro,et al.  Efficient Belief Propagation for Early Vision , 2006 .

[19]  Yasushi Yagi,et al.  Grid-Based Active Stereo with Single-Colored Wave Pattern for Dense One-shot 3D Scan , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[20]  Hans-Peter Seidel,et al.  Motion capture using joint skeleton tracking and surface estimation , 2009, CVPR.

[21]  Yasushi Yagi,et al.  One-shot Entire Shape Acquisition Method Using Multiple Projectors and Cameras , 2010, 2010 Fourth Pacific-Rim Symposium on Image and Video Technology.

[22]  Minoru Maruyama,et al.  Range Sensing By Projecting Multiple Slits With Random Cuts , 1990, Other Conferences.