MagicPad: the projection based 3D user interface

In this paper we describe a novel design and implementation of a tangible user interface framework, namely the MagicPad. The MagicPad is inspired by the concept of Spatially Augmented Reality. By using a wireless pen with any flat surface, such as a piece of paper that receives projected images from a projector, a user is able to perform a variety of interactive visualization and manipulation in the 3D space. The result of the user test is then presented and finally we suggest the possibilities of improving the MagicPad by using a pico projector to replace the wireless pen.

[1]  Raimund Dachselt,et al.  Exploring information spaces by using tangible magic lenses in a tabletop environment , 2010, CHI Extended Abstracts.

[2]  Richard May,et al.  A Survey of Large High-Resolution Display Technologies, Techniques, and Applications , 2006, IEEE Virtual Reality Conference (VR 2006).

[3]  Henry Y. K. Lau,et al.  The magicpad: a spatial augmented reality based user interface , 2010 .

[4]  Morten Fjeld,et al.  Ortholumen: Using Light for Direct Tabletop Input , 2007, Tabletop.

[5]  Tovi Grossman,et al.  PenLight: combining a mobile projector and a digital pen for dynamic visual overlay , 2009, CHI.

[6]  Falko Kuester,et al.  The StarCAVE, a third-generation CAVE and virtual reality OptIPortal , 2009, Future Gener. Comput. Syst..

[7]  Henry Y. K. Lau,et al.  A tangible user interface using spatial Augmented Reality , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[8]  Ramesh Raskar,et al.  Modern approaches to augmented reality , 2005, SIGGRAPH Courses.

[9]  Russell M. Taylor,et al.  VRPN: a device-independent, network-transparent VR peripheral system , 2001, VRST '01.

[10]  Andy Cockburn,et al.  Through the looking glass: the use of lenses as an interface tool for Augmented Reality interfaces , 2004, GRAPHITE '04.

[11]  Denis Gracanin,et al.  A Tangible User Interface System for CAVE Applicat , 2006, IEEE Virtual Reality Conference (VR 2006).

[12]  Raimund Dachselt,et al.  PaperLens: advanced magic lens interaction above the tabletop , 2009, ITS '09.

[13]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[14]  Ed Lantz,et al.  The future of virtual reality: head mounted displays versus spatially immersive displays (panel) , 1996, SIGGRAPH.

[15]  Hong Hua,et al.  Magic Lenses for augmented virtual environments , 2006, IEEE Computer Graphics and Applications.

[16]  Kok-Lim Low,et al.  Interacting with Spatially Augmented Reality , 2022 .

[17]  Johannes Schöning,et al.  Map torchlight: a mobile augmented reality camera projector unit , 2009, CHI Extended Abstracts.

[18]  Ramesh Raskar,et al.  Dynamic Spatially Augmented 3D Painting , 2001 .

[19]  W. Brent Seales,et al.  Multi-projector displays using camera-based registration , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[20]  Andreas M. Kunz,et al.  Digisketch: taming anoto technology on LCDs , 2010, EICS '10.

[21]  Hiroshi Ishii,et al.  Emerging frameworks for tangible user interfaces , 2000, IBM Syst. J..