Foldable augmented papers with a relaxed constraint

This paper presents an interaction approach for augmented reality using the folding with a relaxed constraint. In our approach, the user can fold a paper and see virtual contents overlaid on the paper. The paper can be folded in horizontal, vertical, and diagonal direction. The folded surface is defined as two polygonal planes that are connected in the folding line. The main contribution of this paper are the automatic detection of the folding line and the plane segmentation based on the extended folding model. In addition, the virtual contents can be overlaid on each segment planes by estimating the camera pose of each plane. We develop two interactive augmented reality applications that overlay the virtual contents dynamically when the user fold the paper.

[1]  Brian P. Bailey,et al.  Build your world and play in it: Interacting with surface particles on complex objects , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[2]  Larry S. Davis,et al.  Structure of Applicable Surfaces from Single Views , 2004, ECCV.

[3]  Adrien Bartoli,et al.  Monocular Template-based Reconstruction of Inextensible Surfaces , 2011, International Journal of Computer Vision.

[4]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[5]  Éric Marchand,et al.  Real-time 3D model-based tracking: combining edge and texture information , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[6]  Andrew D. Wilson.  PlayAnywhere: a compact interactive tabletop projection-vision system , 2005, UIST.

[7]  Hideo Saito,et al.  Texture overlay onto deformable surface using HMD , 2004, IEEE Virtual Reality 2004.

[8]  W. Brent Seales,et al.  Image restoration of arbitrarily warped documents , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Vincent Lepetit,et al.  Fast Non-Rigid Surface Detection, Registration and Realistic Augmentation , 2008, International Journal of Computer Vision.

[10]  Hideo Saito,et al.  Clickable augmented documents , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[11]  Jihad El-Sana,et al.  In-place 3D sketching for authoring and augmenting mechanical systems , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[12]  Vincent Lepetit,et al.  The haunted book , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[13]  Hideo Saito,et al.  Random dot markers , 2011, 2011 IEEE Virtual Reality Conference.

[14]  Tosiyasu L. Kunii,et al.  Bending and creasing virtual paper , 1994, IEEE Computer Graphics and Applications.

[15]  David W. Murray,et al.  Full-3D Edge Tracking with a Particle Filter , 2006, BMVC.

[16]  Scott E. Hudson,et al.  Foldable interactive displays , 2008, UIST '08.

[17]  Adrien Bartoli,et al.  A Quasi-Minimal Model for Paper-Like Surfaces , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Hideo Saito,et al.  Foldable augmented maps , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[19]  Ivan Poupyrev,et al.  The MagicBook: a transitional AR interface , 2001, Comput. Graph..

[20]  Vincent Lepetit,et al.  Closed-Form Solution to Non-rigid 3D Surface Registration , 2008, ECCV.

[21]  P. Slavík,et al.  Geodesic-Controlled Developable Surfaces for Modeling Paper Bending , 2007 .

[22]  Anton van den Hengel,et al.  Interactive modelling for AR applications , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.