Constraints for Time-Multiplexed Structured Light with a Hand-held Camera

Multi-frame structured light in projector-camera systems affords high-density and non-contact methods of 3D surface reconstruction. However, they have strict setup constraints which can become expensive and time-consuming. Here, we investigate the conditions under which a projective homography can be used to compensate for small perturbations in pose caused by a hand-held camera. We synthesize data using a pinhole camera model and use it to determine the average 2D reprojection error per point correspondence. This error map is grouped into regions with specified upper-bounds to classify which regions produce sufficiently minimal error to be considered feasible for a structured-light projector-camera system with a hand-held camera. Empirical results demonstrate that a sub-pixel reprojection accuracy is achievable with a feasible geometric constraints

[1]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[2]  David A. Clausi,et al.  Simultaneous Projector-Camera Self-Calibration for Three-Dimensional Reconstruction and Projection Mapping , 2017, IEEE Transactions on Computational Imaging.

[3]  Charles Soussen,et al.  Flexible calibration of structured-light systems projecting point patterns , 2013, Comput. Vis. Image Underst..

[4]  Gordon Wetzstein,et al.  A survey on computational displays: Pushing the boundaries of optics, computation, and perception , 2013, Comput. Graph..

[5]  Aditi Majumder,et al.  Scalable Multi‐view Registration for Multi‐Projector Displays on Vertically Extruded Surfaces , 2010, Comput. Graph. Forum.

[6]  Bingyao Huang,et al.  A Single-shot Camera-Projector Calibration System For Imperfect Planar Targets , 2018, ArXiv.

[7]  Fuqiang Zhong,et al.  A Cost-Effective Single-Shot Structured Light System for 3D Shape Measurement , 2019, IEEE Sensors Journal.

[8]  Joaquim Salvi,et al.  A robust-coded pattern projection for dynamic 3D scene measurement , 1998, Pattern Recognit. Lett..

[9]  Gordon Wetzstein,et al.  The Visual Computing of Projector‐Camera Systems , 2008, SIGGRAPH '08.

[10]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[11]  Ruigang Yang,et al.  Camera-based calibration techniques for seamless multiprojector displays , 2005, IEEE Transactions on Visualization and Computer Graphics.