Towards a Systematic Mapping of Evidence-based UX Guidelines for Room-scale User Interfaces in Extended Reality

User experience (UX) guidelines help designers with many challenges and opportunities when creating XR applications. However, guidelines that can be found from research and industry that offer insights and ideas surrounding UX for XR room-scale User Interfaces (UIs) are often opinions from experts, developers and designers. To validate experts’ stated beliefs, those guidelines should be based on concrete empirical evidence. In this paper, we present a systematic review based on an analysis of 408 peer-reviewed papers determine the state of the art of empirical evidence for guidelines for room-scale UIs. Our study shows that out of these 408 publications, only 26 were empirical studies. We found 9 studies focusing on room-scale UIs where all of these 9 publications created guidelines from an empirical study instead of using an empirical study to evaluate guidelines.

[1]  Yongning Zhu,et al.  A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality , 2021, Multim. Tools Appl..

[2]  Cindy Ziker,et al.  Cross Reality (XR): Challenges and Opportunities Across the Spectrum , 2021, Innovative Learning Environments in STEM Higher Education.

[3]  Tomasz Bednarz,et al.  User Experience in Collaborative Extended Reality: Overview Study , 2020, EuroVR.

[4]  F. Maurer,et al.  Virtual Reality for Understanding Multidimensional Spatiotemporal Phenomena in Neuroscience , 2020, ISS Companion.

[5]  Samuel Alves,et al.  Evaluation of Graphical User Interfaces Guidelines for Virtual Reality Games , 2020, 2020 19th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames).

[6]  Jaziar Radianti,et al.  A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda , 2020, Comput. Educ..

[7]  Hind Kharoub,et al.  3D User Interface Design and Usability for Immersive VR , 2019, Applied Sciences.

[8]  Frank Maurer,et al.  User Experience Guidelines for Designing HMD Extended Reality Applications , 2019, INTERACT.

[9]  Laura Raya,et al.  A Comparative Study of Virtual Reality Methods of Interaction and Locomotion Based on Presence, Cybersickness, and Usability , 2019, IEEE Transactions on Emerging Topics in Computing.

[10]  Magnus Rotvit Perlt Hansen,et al.  Design Principles for Room-Scale Virtual Reality: A Design Experiment in Three Dimensions , 2018, DESRIST.

[11]  Javier Irizarry,et al.  A Usability Study of an Immersive Virtual Reality Platform for Building Design Review: Considerations on Human Factors and User Interface , 2018 .

[12]  Nektarios Georgalas,et al.  User experience evaluation of human representation in collaborative virtual environments , 2017, Personal and Ubiquitous Computing.

[13]  Daniela Quiñones Otey.  A methodology to develop usability / user experience heuristics , 2017, Interacción.

[14]  Rolf Nordahl,et al.  Missing the point: an exploration of how to guide users' attention during cinematic virtual reality , 2016, VRST.

[15]  Kangsoo Kim,et al.  The wobbly table: Increased social presence via subtle incidental movement of a real-virtual table , 2016, 2016 IEEE Virtual Reality (VR).

[16]  Ferran Argelaguet,et al.  The role of interaction in virtual embodiment: Effects of the virtual hand representation , 2016, 2016 IEEE Virtual Reality (VR).

[17]  Dieter Kranzlmuller,et al.  State of the art of virtual reality technology , 2016, 2016 IEEE Aerospace Conference.

[18]  Horst M. Eidenberger,et al.  Indoor skydiving in immersive virtual reality with embedded storytelling , 2015, VRST.

[19]  Rex Hartson,et al.  The UX book, process and guidelines for ensuring a quality user experience by Rex Hartson and Pardha S. Pyla , 2012, SOEN.

[20]  Shailey Minocha,et al.  Designing navigation and wayfinding in 3D virtual learning spaces , 2011, OZCHI.

[21]  Robert W. Lindeman,et al.  Crafting memorable VR experiences using experiential fidelity , 2009, VRST '09.

[22]  Min Liu,et al.  The Importance of Emotional Usability , 2006 .

[23]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[24]  Jodi Forlizzi,et al.  Understanding experience in interactive systems , 2004, DIS '04.

[25]  Shamus P. Smith,et al.  Evaluation for the Design of Experience in Virtual Environments: Modeling Breakdown of Interaction and Illusion , 2001, Cyberpsychology Behav. Soc. Netw..

[26]  Doug A. Bowman,et al.  Formalizing the Design, Evaluation, and Application of Interaction Techniques for Immersive Virtual Environments , 1999, J. Vis. Lang. Comput..

[27]  Fumio Kishino,et al.  Augmented reality: a class of displays on the reality-virtuality continuum , 1995, Other Conferences.

[28]  Anil Çamci,et al.  Cross-platform and Cross-reality Design of Immersive Sonic Environments , 2020, NIME.

[29]  Johanna M. Silvennoinen,et al.  Introducing usability heuristics for mobile map applications , 2013 .

[30]  A. Beu,et al.  Engineering Joy , 2001, IEEE Softw..

[31]  Carl Machover,et al.  Virtual reality , 1994, IEEE Computer Graphics and Applications.