Holistic User eXperience in Mobile Augmented Reality Using User eXperience Measurement Index

User eXperience (UX) evaluation in the field of Mobile Augmented Reality (MAR) is a challenging task, which requires the application of many heterogeneous methods, producing a variety of raw signals and subjective data. This multi-method approach is essential for capturing the holistic UX of any product, service or system. In order to convert this data into information and subsequently knowledge, a comprehensive and scalable system is required which can not only quantify the individual UX metrics but also produce a concise result, which is interpretable by anyone. We call this result, the User Experience Measurement Index, and in this paper we present the results of adopting the mixed method UX evaluation approach for evaluating a prototype MAR application using various methods and sensors, applied before, during, and after its usage. Additionally, we present the methodology and results for calculating the UXMI.

[1]  Sungyoung Lee,et al.  A Multimodal Deep Log-Based User Experience (UX) Platform for UX Evaluation , 2018, Sensors.

[2]  Dayang Rohaya Bt Awang Rambli,et al.  User experience of mobile augmented reality: A review of studies , 2014, 2014 3rd International Conference on User Science and Engineering (i-USEr).

[3]  Yulyani Arifin,et al.  User Experience Metric for Augmented Reality Application: A Review , 2018 .

[4]  Fridolin Wild,et al.  Simulator Sickness in Augmented Reality Training Using the Microsoft HoloLens , 2018, CHI.

[5]  Kaj Helin,et al.  User Experience of Augmented Reality System for Astronaut's Manual Work Support , 2018, Front. Robot. AI.

[6]  Eric Jamet,et al.  Effects of Stereoscopic Display on Learning and User Experience in an Educational Virtual Environment , 2017, Int. J. Hum. Comput. Interact..

[7]  Paul van Schaik,et al.  Attitudes towards user experience (UX) measurement , 2014, Int. J. Hum. Comput. Stud..

[8]  Amir Dirin,et al.  User Experience in Mobile Augmented Reality: Emotions, Challenges, Opportunities and Best Practices , 2018, Comput..

[9]  Martin Schrepp,et al.  Developing a UX KPI based on the user experience questionnaire , 2019, Comput. Stand. Interfaces.

[10]  Mark Billinghurst,et al.  Applying HCI principles to AR systems design , 2007 .

[11]  Evangelos Karapanos,et al.  Reconstructing experiences with iScale , 2012, Int. J. Hum. Comput. Stud..

[12]  Janko Drnovsek,et al.  Influence of video content type on users' virtual reality sickness perception and physiological response , 2019, Future Gener. Comput. Syst..

[13]  Evangelos Karapanos,et al.  User experience over time , 2008, CHI Extended Abstracts.

[14]  Indira Thouvenin,et al.  Contributions of mixed reality in a calligraphy learning task: Effects of supplementary visual feedback and expertise on cognitive load, user experience and gestural performance , 2017, Comput. Hum. Behav..

[15]  Martin Schrepp,et al.  User Experience Questionnaire (UEQ) Benchmark. Praxiserfahrungen zur Auswertung und Anwendung von UEQ-Erhebungen im Business-Umfeld , 2013, UP.

[16]  P. Desmet,et al.  Researcher introspection for experience-driven design research , 2019, Design Studies.

[17]  Bruce H. Thomas,et al.  Evaluation of user satisfaction and learnability for outdoor augmented reality gaming , 2006, AUIC.

[18]  Evangelos Karapanos,et al.  On the retrospective assessment of users' experiences over time: memory or actuality? , 2010, CHI Extended Abstracts.

[19]  M. Pallot,et al.  A holistic model of user experience for living lab experiential design , 2012, 2012 18th International ICE Conference on Engineering, Technology and Innovation.

[20]  Min Tang,et al.  Exploiting user experience from online customer reviews for product design , 2019, Int. J. Inf. Manag..

[21]  Carsten Lecon.  Motion Sickness in VR Learning Environments , 2018 .

[22]  B. J. Fogg,et al.  A behavior model for persuasive design , 2009, Persuasive '09.