Surface-Independent Direct-Projected Augmented Reality

Some issues on direct-projected augmented reality (DirectAR) are addressed: the projection may be geometrically distorted due to the non-planar surface (geometric distortion); the projection cannot be seen to user as intended because the position of the projector is not the same as that of the user’s viewpoint (viewpoint-ignorant projection); the projection may be modulated by surface color (radiometric distortion); the projected area may not have uniform brightness when the projection is obliquely headed for the surface (uneven projection). We propose an integrated framework for handling all the problems. Experimental results demonstrate that the problems unavoidable in surface-independent DirectAR can be successfully resolved.

[1]  Jong-Il Park,et al.  Specular reflection elimination for projection-based augmented reality , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[2]  Kunihiro Chihara,et al.  Projection-based augmented reality with automated shape scanning , 2005, IS&T/SPIE Electronic Imaging.

[3]  John M. Snyder,et al.  Ray tracing complex models containing surface tessellations , 1987, SIGGRAPH.

[4]  Shree K. Nayar,et al.  Making one object look like another: controlling appearance using a projector-camera system , 2004, CVPR 2004.

[5]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Gordon Wetzstein,et al.  Enabling view-dependent stereoscopic projection in real environments , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[7]  Rajeev J. Surati.  Scalable self-calibrating display technology for seamless large-scale displays , 1999 .

[8]  Tomas Lozano-Perez,et al.  An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization , 1996 .

[9]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[10]  Marc Pollefeys,et al.  Multiple view geometry , 2005 .

[11]  Rahul Sukthankar,et al.  Smarter Presentations: Exploiting Homography in Camera-Projector Systems , 2001, ICCV.

[12]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).