Just Say It: An Evaluation of Speech Interfaces for Augmented Reality Design Applications

Design has been one of the most successful application areas for augmented reality (AR) technology. However, because of the head-mounted-displays typically used in immersive AR applications users are not able to use traditional interface modalities such as keyboards and mice. Speech interfaces offer an attractive solution to this problem. Using an interior design application this paper describes an evaluation experiment which shows that speech interfaces are an attractive control solution for AR design applications.

[1]  Andrew Sears,et al.  The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications (Human Factors and Ergonomics Series) , 2007 .

[2]  Heedong Ko,et al.  An Evaluation of an Augmented Reality Multimodal Interface Using Speech and Paddle Gestures , 2006, ICAT.

[3]  David E. Breen,et al.  Distributed Augmented Reality for Collaborative Design Applications , 1995, Comput. Graph. Forum.

[4]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[5]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[6]  J. Jacko,et al.  The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications , 2002 .

[7]  Ivan Poupyrev,et al.  Virtual object manipulation on a table-top AR environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[8]  James H. Martin,et al.  Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition, 2nd Edition , 2000, Prentice Hall series in artificial intelligence.

[9]  Marc Aurel Schnabel,et al.  Mixed Reality In Architecture, Design, And Construction , 2008 .

[10]  Natalia N. Modjeska,et al.  Resolving Other-Anaphora , 2004 .

[11]  Rynson W. H. Lau,et al.  Advances in Artificial Reality and Tele-Existence, 16th International Conference on Artificial Reality and Telexistence, ICAT 2006, Hangzhou, China, November 29 - December 1, 2006, Proceedings , 2006, ICAT.

[12]  Xiangyu Wang,et al.  Mixed Reality-Based Visualization Interfaces for Architecture, Engineering, and Construction Industry , 2005 .

[13]  John D. Kelleher,et al.  Proximity in Context: An Empirically Grounded Computational Model of Proximity for Processing Topological Spatial Expressions , 2006, ACL.

[14]  Bruce H. Thomas,et al.  Augmented Reality Visualisation Facilitating The Architectural Process , 2009 .

[15]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[16]  Terry Winograd,et al.  Understanding natural language , 1974 .