Occlusion based interaction methods for tangible augmented reality environments

Traditional Tangible Augmented Reality (Tangible AR) interfaces combine a mixture of tangible user interface and augmented reality technology, complementing each other for novel interaction methods and real world anchored visualization. However, well known conventional one and two dimensional interaction methods such as pressing buttons, changing slider values, or menu selections are often quite difficult to apply to Tangible AR interfaces. In this paper we suggest a new approach, occlusion based interaction, in which visual occlusion of physical markers are used to provide intuitive two dimensional interaction in Tangible AR environments. We describe how to implement occlusion based interfaces for Tangible AR environments, give several examples of applications and describe results from informal user studies.

[1]  T. Pintaric,et al.  An adaptive thresholding algorithm for the augmented reality toolkit , 2003, 2003 IEEE International Augmented Reality Toolkit Workshop.

[2]  Ivan Poupyrev,et al.  Augmented Groove: Collaborative Jamming in Augmented Reality , 2000, SIGGRAPH 2000.

[3]  Desney S. Tan,et al.  Developing a Generic Augmented-Reality Interface , 2002, Computer.

[4]  Michael Gervautz,et al.  The Personal Interaction Panel – a Two‐Handed Interface for Augmented Reality , 1997, Comput. Graph. Forum.

[5]  Naokazu Yokoya,et al.  A collaboration support technique by integrating a shared virtual reality and a shared augmented reality , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[6]  Hirokazu Kato,et al.  A registration method based on texture tracking using ARToolKit , 2003, 2003 IEEE International Augmented Reality Toolkit Workshop.

[7]  Ivan Poupyrev,et al.  Tangible Augmented Reality for Human Computer Interaction , 2002 .

[8]  Jun Rekimoto,et al.  SmartSkin: an infrastructure for freehand manipulation on interactive surfaces , 2002, CHI.

[9]  Steven K. Feiner,et al.  Windows on the world: 2D windows for 3D augmented reality , 1993, UIST '93.

[10]  Ivan Poupyrev,et al.  The MagicBook - Moving Seamlessly between Reality and Virtuality , 2001, IEEE Computer Graphics and Applications.

[11]  Ivan Poupyrev,et al.  Virtual object manipulation on a table-top AR environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[12]  Gerhard Roth,et al.  Replacing a Mouse with Hand Gesture in a Plane-Based Augmented Reality System , 2003 .

[13]  Bruce H. Thomas,et al.  Using ARToolKit for 3D hand position tracking in mobile outdoor environments , 2002, The First IEEE International Workshop Agumented Reality Toolkit,.

[14]  Christian Geiger,et al.  3D-registered interaction-surfaces in augmented reality space , 2003, 2003 IEEE International Augmented Reality Toolkit Workshop.

[15]  Hirokazu Kato,et al.  Explorations in the Use of Augmented Reality for Geographic Visualization , 2002, Presence: Teleoperators & Virtual Environments.

[16]  Ivan Poupyrev,et al.  Mixing realities in Shared Space: an augmented reality interface for collaborative computing , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[17]  José Miguel Salles Dias,et al.  In your hand computing: tangible interfaces for mixed reality , 2003, 2003 IEEE International Augmented Reality Toolkit Workshop.