Usability Engineering of Virtual Environments

To this end, we present several usability engineering methods, mostly adapted from GUI development, that have been successfully applied to VE development. These methods include user task analysis, expert guidelines-based evaluation (also sometimes called heuristic evaluation or usability inspection), and formative usability evaluation. Further, we postulate that — like GUI development — there is no single method for VE usability engineering, and we address how each of these methodologies supports focused, specialized design, measurement, management, and assessment techniques such as those presented in other chapters of this Handbook {NOTE TO EDITOR: these will be listed as appropriate as we see how other chapters are completed}. We include our experiences with usability engineering of three different VEs: one was a desktop -based new interaction technique, one was a CAVE -based medical imaging system, and one was a Responsive Workbench-based navigation application. We also discuss summative evaluation, even though it is not a usability engineering method per se. We present summative evaluation because it is an important aspect of making comparative assessments of VEs from a user's perspective.

[1]  H. Rex Hartson,et al.  Developing user interfaces: ensuring usability through product & process , 1993 .

[2]  Floraline I. Stevens User-friendly handbook for project evaluation , 1994 .

[3]  Alistair G. Sutcliffe,et al.  Heuristic evaluation of virtual reality applications , 2004, Interact. Comput..

[4]  S.J. Julier,et al.  Using multiple SLAM algorithms , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[5]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[6]  Janice Redish,et al.  User and task analysis for interface design , 1998 .

[7]  Tobias Höllerer,et al.  Resolving multiple occluded layers in augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[8]  Deborah Hix,et al.  Pre-screen projection: from concept to testing of a new interaction technique , 1995, CHI '95.

[9]  Robert J. K. Jacob,et al.  The perceptual structure of multidimensional input device selection , 1992, CHI.

[10]  Deborah Hix,et al.  An Augmented Reality System for Military Operations in Urban Terrain , 2002 .

[11]  Doug A. Bowman,et al.  Overcoming World in Miniature Limitations by a Scaled and Scrolling WIM , 2006, 3D User Interfaces (3DUI'06).

[12]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[13]  Simon J. Julier,et al.  A tracker alignment framework for augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[14]  Deborah Hix,et al.  User-centered design and evaluation of a real-time battlefield visualization virtual environment , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[15]  Kay M. Stanney,et al.  Handbook of Virtual Environments - Design, Implementation, and Applications, Second Edition , 2014, Handbook of Virtual Environments, 2nd ed..

[16]  Jeffrey A. Lewis,et al.  Usability of the Remote Console for Virtual Reality Telerehabilitation: Formative Evaluation , 2006, Cyberpsychology Behav. Soc. Netw..

[17]  Barney Dalgarno,et al.  The potential of virtual laboratories for distance education science teaching: reflections from the development and evaluation of a virtual chemistry laboratory , 2012 .

[18]  Marc M. Sebrechts,et al.  HANDBOOK OF VIRTUAL ENVIRONMENTS , 2014 .

[19]  Deborah Hix,et al.  The Effects of Text Drawing Styles, Background Textures, and Natural Lighting on Text Legibility in Outdoor Augmented Reality , 2006, Presence: Teleoperators & Virtual Environments.

[20]  S. Kennedy,et al.  Using video in the BNR usability lab , 1989, SGCH.

[21]  Deborah Hix,et al.  Evaluating the Usability of Crumbs: A Case Study of VE Usability Engineering , 1999 .

[22]  Xiangyu Wang,et al.  Usability Evaluation of a Mixed Reality Collaborative Tool for Design Review , 2006, International Conference on Computer Graphics, Imaging and Visualisation (CGIV'06).

[23]  Robert C. Williges,et al.  An Evaluation of Critical Incidents for Software Documentation Design , 1986 .

[24]  M. Carter Computer graphics: Principles and practice , 1997 .

[25]  S.J. Julier,et al.  An empirical study into the robustness of split covariance addition (SCA) for human motion tracking , 2004, Proceedings of the 2004 American Control Conference.

[26]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[27]  Antonio Pflüger,et al.  Executive Summary. , 2012, Journal of the ICRU.

[28]  Deborah Hix,et al.  A Perceptual Matching Technique for Depth Judgments in Optical, See-Through Augmented Reality , 2006, IEEE Virtual Reality Conference (VR 2006).

[29]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[30]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[31]  A. Komlodi,et al.  Empirical usability evaluation of the Wii controller as an input device for the VirCA immersive virtual space , 2011, 2011 2nd International Conference on Cognitive Infocommunications (CogInfoCom).

[32]  Floraline Stevens,et al.  User-Friendly Handbook for Project Evaluation: Science, Mathematics, Engineering, and Technology Education. , 1993 .

[33]  J. Edward Swan,et al.  Usability Engineering for Augmented Reality: Employing User-Based Studies to Inform Design , 2008, IEEE Transactions on Visualization and Computer Graphics.

[34]  Deborah Hix,et al.  A comparative study of user performance in a map-based virtual environment , 2003, IEEE Virtual Reality, 2003. Proceedings..

[35]  Deborah Hix,et al.  Active Text Drawing Styles for Outdoor Augmented Reality: A User-Based Study and Design Implications , 2007, 2007 IEEE Virtual Reality Conference.

[36]  Jakob Nielsen,et al.  Chapter 4 – The Usability Engineering Lifecycle , 1993 .

[37]  M. Scriven The methodology of evaluation , 1966 .

[38]  Alexandra Landsberg,et al.  Virtual Workbench-a non-immersive virtual environment for visualizing and interacting with 3D objects for scientific visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[39]  Helmut Berger,et al.  Towards a holistic methodology for engineering 3D Virtual World applications , 2010, 2010 International Conference on Information Society.