Adaptive Image Projection onto Non-planar Screen Using Projector-Camera Systems

In this paper, we propose a method for projecting images onto non-planar screens by using projector-camera systems eliminating distortion in projected images. In this system, point-to-point correspondences in a projector image and a camera image should be extracted. For finding correspondences, the epipolar geometry between a projector and a camera is used. By using dynamic programming method on epipolar lines, correspondences between projector image and camera image are obtained. Furthermore, in order to achieve faster and more robust matching, the non-planar screen is approximately represented by a B-spline surface. The small number of parameters for the B-spline surface are estimated from corresponding pixels on epipolar lines rapidly. Experimental results show the proposed method works well for projecting images onto non-planar screens.

[1]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[2]  Paul A. Beardsley,et al.  Natural video matting using camera arrays , 2006, ACM Trans. Graph..

[3]  Jun Sato,et al.  3D Reconstruction from Uncalibrated Cameras and Uncalibrated Projectors from Shadows , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[4]  Takahiro Okabe,et al.  Radiometric Compensation in a Projector-Camera System Based Properties of Human Vision System , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[5]  Yoichi Sato,et al.  Interaction for entertainment contents based on direct manipulation with bare hands , 2002, IWEC.

[6]  Ruigang Yang,et al.  Automatic and Continuous Projector Display Surface Estimation Using Everyday Imagery , 2001, WSCG.

[7]  Takayuki Okatani,et al.  Autocalibration of a projector-camera system , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  H. Opower Multiple view geometry in computer vision , 2002 .