Real-Time Projector Tracking on Complex Geometry Using Ordinary Imagery

Using cameras to geometrically calibrate projector-based displays has been widely reported in the literature over the last decade. Most systems project structured-light patterns during a setup phase before starting the application in order to evaluate the geometric mapping from projector pixels to locations on the display surface. If this mapping changes e.g. the projector is moved, the application must be stopped and calibration re-initiated. Our pose estimation technique is based on detecting a set of image correspondences between the moving projector and a static camera using only the imagery displayed by the projector. We use an up-front calibration process to establish the geometry of the display surface, the pose of the camera, and the initial pose of the projector.

[1]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[2]  Markus H. Gross,et al.  Adaptive Instant Displays: Continuously Calibrated Projections Using Per‐Pixel Light Control , 2005, Comput. Graph. Forum.

[3]  Henry Fuchs,et al.  RANSAC-Assisted Display Model Reconstruction for Projective Display , 2006, IEEE Virtual Reality Conference (VR 2006).

[4]  Ruigang Yang,et al.  Automatic and Continuous Projector Display Surface Estimation Using Everyday Imagery , 2001, WSCG.

[5]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[6]  Paul A. Beardsley,et al.  Natural video matting using camera arrays , 2006, ACM Trans. Graph..

[7]  Shree K. Nayar,et al.  A Projection System with Radiometric Compensation for Screen Imperfections , 2003 .

[8]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[9]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[10]  Marc Pollefeys,et al.  Auto-calibration of multi-projector display walls , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[11]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Oliver Bimber,et al.  Embedded entertainment with smart projectors , 2005, Computer.

[13]  W. Brent Seales,et al.  Multi-projector displays using camera-based registration , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[14]  Mark Ashdown,et al.  A flexible projector-camera system for multi-planar displays , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[15]  Gordon Wetzstein,et al.  Enabling view-dependent stereoscopic projection in real environments , 2005, SIGGRAPH '05.

[16]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[17]  Linda G. Shapiro,et al.  Computer and Robot Vision (Volume II) , 2002 .

[18]  Markus H. Gross,et al.  Embedding imperceptible patterns into projected images for simultaneous acquisition and display , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[19]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.