Exploitation of heuristics for virtual environments

Although generic usability heuristics lists have been popular with researchers and practitioners, emerging new technologies have called for more specific heuristics. One of these heuristics was proposed by Sutcliffe and Gault in 2004 [37]. This paper examines research which has cited these heuristics with the aim to see how it has been exploited. The results showed that a fifth of the papers citing the heuristics have used the heuristics fully or partly, and that researchers have adapted it to their current needs. Following this result we proposed that a patchwork of heuristics might be more useful than a single list. We evaluated a crisis management training simulator using the virtual reality heuristics and discussed how the outcome of the evaluation fitted the patchwork.

[1]  John R. Wilson,et al.  Systematic Usability Evaluation and Design Issues for Collaborative Virtual Environments , 2003, Presence: Teleoperators & Virtual Environments.

[2]  Carlo Galimberti,et al.  An Integrated Approach to the Ergonomic Analysis of VR in Psychotherapy: Panic Disorders, Agoraphobia and Eating Disorders , 2004, Cybertherapy.

[3]  Imre Horváth,et al.  Using Hybrid Heuristic Evaluation Method to Uncover the Conceptual Design Tasks Supported by a Holographic Display Based Truly 3D Virtual Design Environment , 2008 .

[4]  Jakob Nielsen,et al.  Enhancing the explanatory power of usability heuristics , 1994, CHI '94.

[5]  Jennifer Preece,et al.  Predicting quality in educational software: Evaluating For Learning, Usability and the Synergy between Them , 1999, Interact. Comput..

[6]  Alistair G. Sutcliffe,et al.  Heuristic evaluation of virtual reality applications , 2004, Interact. Comput..

[7]  H. F. Manesh,et al.  AC 2010-24: A VIRTUAL FACTORY APPROACH FOR DESIGN AND IMPLEMENTATION OF AGILE MANUFACTURING SYSTEMS , 2010 .

[8]  Monica Bordegoni,et al.  Multimodal Navigation for a Haptic-Based Virtual Assembly Application , 2010 .

[9]  Kasper Hornbæk,et al.  Dogmas in the assessment of usability evaluation methods , 2010, Behav. Inf. Technol..

[10]  Ebba Þóra Hvannberg,et al.  Heuristic evaluation: Comparing ways of finding and reporting usability problems , 2007, Interact. Comput..

[11]  Nguyen-Thong Dang,et al.  A Framework for Design and Evaluation of Collaborative Virtual Environments , 2008 .

[12]  Imre Horváth,et al.  Towards an interactive spatial product visualisation: a comparative analysis of prevailing 3D visualisation paradigms , 2010 .

[13]  Kasper Hornbæk,et al.  Ingredients and Meals Rather Than Recipes: A Proposal for Research That Does Not Treat Usability Evaluation Methods as Indivisible Wholes , 2011, Int. J. Hum. Comput. Interact..

[14]  Jan Gulliksen,et al.  Usability professionals - current practices and future development , 2006, Interact. Comput..

[15]  Wenjun Ma AMMP-EXTN: A User Privacy and Collaboration Control Framework for a Multi-User Collaboratory Virtual Reality System , 2007 .

[16]  Philip N. Day,et al.  System design and user evaluation of Co-Star: An immersive stereoscopic system for cable harness design , 2007, Comput. Aided Des..

[17]  C. John Why 'traditional' HCI techniques fail to support desktop VR , 1998 .

[18]  Suziah Sulaiman,et al.  Development of usability evaluation framework for haptic systems , 2011, 2011 IEEE International Symposium on VR Innovation.

[19]  Alistair G. Sutcliffe,et al.  Assessing the reliability of heuristic evaluation for Web site attractiveness and usability , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[20]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[21]  Matteo Cantamesse,et al.  The development of an integrated psychosocial approach to effective usability of 3D Virtual Environments for Cybertherapy , 2006, PsychNology J..

[22]  Dominique L. Scapin,et al.  Ergonomic criteria adapted to human virtual environment interaction , 2003, IHM '03.

[23]  Mel Slater,et al.  Immersion, presence and performance in virtual environments: an experiment with tri-dimensional chess , 1996, VRST.

[24]  Umberto Cugini,et al.  Evaluation of a Haptic-Based Interaction System for Virtual Manual Assembly , 2009, HCI.

[25]  Joseph L. Gabbard A Taxonomy of Usability Characteristics in Virtual Environments , 1997 .

[26]  Alistair G. Sutcliffe,et al.  Evaluating the usability of virtual reality user interfaces , 2000, Behav. Inf. Technol..

[27]  Carl Gutwin,et al.  Usability heuristics for networked multiplayer games , 2009, GROUP.

[28]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[29]  R S Kalawsky,et al.  VRUSE--a computerised diagnostic tool: for usability evaluation of virtual/synthetic environment systems. , 1999, Applied ergonomics.

[30]  Jan Gulliksen,et al.  Making a difference: a survey of the usability profession in Sweden , 2004, NordiCHI '04.

[31]  Hanna Strömberg,et al.  A group game played in interactive virtual space: design and evaluation , 2002, DIS '02.

[32]  Doug A. Bowman,et al.  A Survey of Usability Evaluation in Virtual Environments: Classification and Comparison of Methods , 2002, Presence: Teleoperators & Virtual Environments.

[33]  Jonathan Blackledge,et al.  Evaluation of a Prototype Desktop Virtual Reality Model Developed to Enhance Electrical Safety and Design in the Built Environment , 2012 .

[34]  David Pinelle,et al.  Heuristic evaluation for games: usability principles for video game design , 2008, CHI.

[35]  Carlos Flavián,et al.  A heuristic evaluation of websites design for achieving the web success , 2009, Int. J. Serv. Stand..

[36]  Mark Billinghurst,et al.  Evaluating Augmented Reality Systems , 2011, Handbook of Augmented Reality.

[37]  Jan Stage,et al.  Obstacles to usability evaluation in practice: a survey of software development organizations , 2008, NordiCHI.

[38]  Imre Horváth,et al.  Exploring the viability of holographic displays for product visualisation , 2010 .

[39]  Venkataraman Ramesh,et al.  An analysis of research in computing disciplines , 2004, CACM.