Autocalibration of a projector-screen-camera system: theory and algorithm for screen-to-camera homography estimation

This paper deals with the autocalibration of a system that consists of a planar screen, multiple projectors, and a camera. In the system, either multiple projectors or a single moving projector projects patterns on a screen while a stationary camera placed in front of the screen takes images of the patterns. We treat the case in which the patterns that the projectors project toward space are assumed to be known (i.e., the projectors are calibrated), whereas poses of the projectors are unknown. Under these conditions, we consider the problem of estimating screen-to-camera homography from the images alone. This is intended for cases where there is no clue on the screen surface that enables direct estimation of the screen-to-camera homography. One application is a 6DOF input device; poses of a multibeam projector freely moving in space are computed from the images of beam spots on the screen. The primary contribution of the paper is theoretical results on the uniqueness of solutions and a noniterative algorithm for the problem. The effectiveness of the method is shown by experimental results on synthetic as well as on real images.

[1]  Reinhard Koch,et al.  Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters , 1999, International Journal of Computer Vision.

[2]  Kenichi Kanatani,et al.  Geometric computation for machine vision , 1993 .

[3]  Rahul Sukthankar,et al.  Smarter Presentations: Exploiting Homography in Camera-Projector Systems , 2001, ICCV.

[4]  Anders Heyden,et al.  Flexible calibration: minimal cases for auto-calibration , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  Adam Finkelstein,et al.  Automatic alignment of high-resolution multi-projector display using an un-calibrated camera , 2000, IEEE Visualization.

[6]  Reinhard Koch,et al.  Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[7]  Anders Heyden Reduced Multilinear Constraints: Theory and Experiments , 2004, International Journal of Computer Vision.

[8]  Anders Heyden,et al.  Minimal Conditions on Intrinsic Parameters for Euclidean Reconstruction , 1998, ACCV.

[9]  Rahul Sukthankar,et al.  Smarter presentations: exploiting homography in camera-projector systems , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.