Feature-based Alignment Method for Projecting Virtual Content on a Movable Paper Map

In this paper we propose a feature-based alignment method for visualizing geographical content on a movable paper map using non-calibrated projector-camera pair. In order to project correctly aligned geographical content on a movable paper map, we detect two kinds of features: printed features and projected features on a paper map. First, we print landmark points as map features on the paper map for registration purpose. We then project landmark points onto the paper map. We then detect these printed and projected features simultaneously. The transformation from the projector coordinate system to the image coordinate system is estimated using the feature correspondences. This transformation is used to warp the geographical content before the corrected projection. In succeeding frames, the features are tracked in order to update the transformation. We evaluated our method against the motion of the paper map, the camera and the projector with average projection error of 9.5 pixels.

[1]  Masanori Sugimoto,et al.  A Portable Projector Extended for Object-Centered Real-Time Interactions , 2009, 2009 Conference for Visual Media Production.

[2]  Kin Hong Wong,et al.  A projector-based movable hand-held display system , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Hideo Saito,et al.  Towards Bendable Augmented Maps , 2011, MVA.

[4]  Hideo Saito,et al.  Foldable augmented maps , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[5]  Paul A. Beardsley,et al.  A Handheld Projector Supported by Computer Vision , 2006, ACCV.

[6]  Hideo Saito,et al.  Foldable augmented papers with a relaxed constraint , 2011, 2011 1st International Symposium on Access Spaces (ISAS).

[7]  Hideo Saito,et al.  Random dot markers , 2011, 2011 IEEE Virtual Reality Conference.

[8]  Yasushi Yagi,et al.  A Sensor for Simultaneously Capturing Texture and Shape by Projecting Structured Infrared Light , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[9]  Jianbo Shi,et al.  Tele-graffiti: a pen and paper-based remote sketching system , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  Ramesh Raskar,et al.  Modern approaches to augmented reality: introduction to current approaches , 2006, SIGGRAPH Courses.

[11]  Kin Hong Wong,et al.  A projector-based movable hand-held display system , 2009, CVPR.

[12]  Antonio Krüger,et al.  LittleProjectedPlanet: An Augmented Reality Game for Camera Projector Phones , 2009 .

[13]  Oliver Bimber,et al.  Passive-Active Geometric Calibration for View-Dependent Projections onto Arbitrary Surfaces , 2007, J. Virtual Real. Broadcast..

[14]  Éric Marchand,et al.  Toward augmenting everything: Detecting and tracking geometrical features on planar objects , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[15]  Scott E. Hudson,et al.  Foldable interactive displays , 2008, UIST '08.

[16]  Michitaka Hirose,et al.  Projected Reality - Content Delivery Right onto Objects of Daily Life , 2006 .

[17]  Masatoshi Okutomi,et al.  Direct image alignment of projector-camera systems with planar surfaces , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Teng-Wen Chang,et al.  1:1 Spatially Augmented Reality Design Environment , 2006 .

[19]  Enrico Rukzio,et al.  Projector Phone Interactions: Design Space and Survey , 2010 .