A system for evaluating augmented reality user interfaces in wearable computers

Usability tests with wearable computers are difficult to conduct due to the nature of wearable computers. Wearable computers are intended for personal use and the test supervisor does not know exactly what the test subject is currently seeing in augmented reality through the head-worn display of the wearable computer. Due to this personal nature, the concepts of traditional usability testing need some rethinking. This paper presents a combination of techniques that connects the computers of the test subject and the supervisor. Both of the computers share the same view of augmented reality and the supervisor knows exactly what the user is doing and what state the computer is in. All actions and sensor data are also recorded for later analysis. Complete usability tests have been made with this system and the system fulfilled its goals.

[1]  Juha Lehikoinen.  An Evaluation of Augmented Reality Navigational Maps in Head-Worn Displays , 2001, INTERACT.

[2]  Ismo Rakkolainen,et al.  Visualizing real-time GPS data with Internet's VRML Worlds , 1998, GIS '98.

[3]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[4]  Gregory D. Abowd,et al.  Cyberguide: A mobile context‐aware tour guide , 1997, Wirel. Networks.

[5]  Marja Salmimaa,et al.  MEX: a distributed software architecture for wearable computers , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[6]  Gerd Kortuem,et al.  A collaborative wearable system with remote sensing , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[7]  Leonard J. Bass,et al.  Adtranz: a mobile computing system for maintenance and collaboration , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[8]  Bruce H. Thomas,et al.  Integrating virtual and augmented realities in an outdoor application , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[9]  Riku Suomela,et al.  Context compass , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[10]  Leonard J. Bass,et al.  The design of a wearable computer , 1997, CHI.

[11]  Gregory D. Abowd,et al.  Rapid prototyping of mobile context-aware applications: the Cyberguide case study , 1996, MobiCom '96.

[12]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[13]  Bruce H. Thomas,et al.  A wearable computer system with augmented reality to support terrestrial navigation , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[14]  Gerd Kortuem,et al.  NETMAN: The design of a collaborative wearable computer system , 1999, Mob. Networks Appl..