Advanced Interaction Techniques for Augmented Reality Applications

Augmented Reality (AR) research has been conducted for several decades, although until recently most AR applications had simple interaction methods using traditional input devices. AR tracking, display technology and software has progressed to the point where commercial applications can be developed. However there are opportunities to provide new advanced interaction techniques for AR applications. In this paper we describe several interaction methods that can be used to provide a better user experience, including tangible user interaction, multimodal input and mobile interaction.

[1]  Steven K. Feiner,et al.  Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system , 1999, Comput. Graph..

[2]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[3]  S. Kicha Ganapathy,et al.  A synthetic visual environment with hand gesturing and voice input , 1989, CHI '89.

[4]  Ivan Poupyrev,et al.  The go-go interaction technique: non-linear mapping for direct manipulation in VR , 1996, UIST '96.

[5]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[6]  Michael Haller,et al.  Mixed reality training application for an oil refinery: user requirements , 2004, VRCAI '04.

[7]  Hideyuki Tamura,et al.  Welbo: an embodied conversational agent living in mixed reality space , 2000, CHI Extended Abstracts.

[8]  Mark Weiser.  The computer for the 21st century , 1991 .

[9]  Steven K. Feiner,et al.  Enveloping users and computers in a collaborative 3D augmented reality , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[10]  Marc Olano,et al.  3DM: a three dimensional modeler using a head-mounted display , 1992, I3D '92.

[11]  Naokazu Yokoya,et al.  A collaboration support technique by integrating a shared virtual reality and a shared augmented reality , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[12]  Mark Billinghurst,et al.  AR Pad: an interface for face-to-face AR collaboration , 2002, CHI Extended Abstracts.

[13]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[14]  Heedong Ko,et al.  An Evaluation of an Augmented Reality Multimodal Interface Using Speech and Paddle Gestures , 2006, ICAT.

[15]  Steven K. Feiner,et al.  Mutual disambiguation of 3D multimodal interaction in augmented and virtual reality , 2003, ICMI '03.

[16]  Jun Rekimoto,et al.  Augment-able reality: situated communication through physical and digital spaces , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[17]  Joseph L. Gabbard.  A Taxonomy of Usability Characteristics in Virtual Environments , 1997 .

[18]  Mark Billinghurst,et al.  Virtual object manipulation using a mobile phone , 2005, ICAT '05.

[19]  Matthias Denecke.  Rapid Prototyping for Spoken Dialogue Systems , 2002, COLING.

[20]  Oliver Bimber,et al.  Video see-through AR on consumer cell-phones , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[21]  Hiroshi Ishii,et al.  Triangles: tangible interface for manipulation and exploration of digital information topography , 1998, CHI.

[22]  Ivan Poupyrev,et al.  Tangible Augmented Reality for Human Computer Interaction , 2002 .

[23]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[24]  Dieter Schmalstieg,et al.  Bridging multiple user interface dimensions with augmented reality , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[25]  Steven K. Feiner,et al.  SenseShapes: using statistical geometry for object selection in a multimodal augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[26]  Rynson W. H. Lau,et al.  Advances in Artificial Reality and Tele-Existence, 16th International Conference on Artificial Reality and Telexistence, ICAT 2006, Hangzhou, China, November 29 - December 1, 2006, Proceedings , 2006, ICAT.

[27]  Dennis Proffitt,et al.  Cooperative bimanual action , 1997, CHI.

[28]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[29]  Dieter Schmalstieg,et al.  First steps towards handheld augmented reality , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[30]  J. Underkoff.  Urp : A Luminous-Tangible Workbench for Urban Planning and Design , 1999, CHI 1999.

[31]  Mark Ollila,et al.  UMAR: Ubiquitous Mobile Augmented Reality , 2004, MUM '04.

[32]  Ivan Poupyrev,et al.  Virtual object manipulation on a table-top AR environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[33]  Jr. Joseph J. LaViola,et al.  Whole-Hand and Speech Input in Virtual Environments , 1999 .

[34]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[35]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[36]  M. Weiser.  The Computer for the Twenty-First Century , 1991 .

[37]  Ivan E. Sutherland,et al.  The Ultimate Display , 1965 .