Virtual object manipulation on a table-top AR environment

We address the problems of virtual object interaction and user tracking in a table-top augmented reality (AR) interface. In this setting there is a need for very accurate tracking and registration techniques and an intuitive and useful interface. This is especially true in AR interfaces for supporting face to face collaboration where users need to be able to easily cooperate with each other. We describe an accurate vision-based tracking method for table-top AR environments and tangible user interface (TUI) techniques based on this method that allow users to manipulate virtual objects in a natural and intuitive manner. Our approach is robust, allowing users to cover some of the tracking markers while still returning camera viewpoint information, overcoming one of the limitations of traditional computer vision based systems. After describing this technique we describe its use in prototype AR applications.

[1]  Geri Gay,et al.  Use of Communication Resources in a Networked Collaborative Design Environment , 2006, J. Comput. Mediat. Commun..

[2]  D. Schmalsteig,et al.  Studierstube-An Environment for Collaboration in Augmented Reality , 1996 .

[3]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[4]  Hunter G. Hoffman,et al.  Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[5]  Naokazu Yokoya,et al.  Collaborative immersive workspace through a shared augmented environment , 1998, Other Conferences.

[6]  Hiroshi Ishii,et al.  Triangles: tangible interface for manipulation and exploration of digital information topography , 1998, CHI.

[7]  Ivan Poupyrev,et al.  Virtual Notepad: handwriting in immersive VR , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[8]  Hideyuki Tamura,et al.  AR/sup 2/Hockey: a case study of collaborative augmented reality , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[9]  H. Kato,et al.  An Augmented Reality System and its Calibration Based on Marker Tracking , 1999 .

[10]  Robert W. Lindeman,et al.  Towards usable VR: an empirical study of user interfaces for immersive virtual environments , 1999, CHI '99.

[11]  Sean White,et al.  Tangible progress: less is more in Somewire audio spaces , 1999, CHI '99.

[12]  Mark Billinghurst,et al.  Shared space: collaborative augmented reality , 1999, International Conference on Computer Graphics and Interactive Techniques.

[13]  Steven K. Feiner,et al.  Enveloping users and computers in a collaborative 3D augmented reality , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[14]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[15]  Naokazu Yokoya,et al.  Stereo Vision Based Video See-through Mixed Reality , 1999 .

[16]  Hirokazu Kato,et al.  Collaborative augmented reality , 2002, CACM.