A platform for UX assessment based on self-reporting techniques

Self-report techniques for capturing User eXperience (UX) are increasingly being used in a variety of contexts. The number of appropriate tools to assist UX evaluators in performing their activities, however, is still quite small. Typically, existing tools provide only one technique, making it difficult to compare and choose the most appropriate technique for a given scenario and the sentiments to be captured. This paper presents the UXSense platform. UXSense aims to help evaluators with the task of selecting the appropriate UX technique, create the forms to execute the evaluation and offer the computational infrastructure to capture, analyze and present the data. To identify the limitations and potentialities of the platform, a pilot test was carried out with university students who were being submitted to active educational methodologies in the discipline of Human-Computer Interaction. Based on the evaluation of the results, it was collected some evidence indicating that the use of the platform can help the UX evaluators to carry out their activities in different contexts, using different techniques of UX capture and according to the types of feelings to be measured.

[1]  Xiao Liu,et al.  Optimized Facial Emotion Recognition Technique for Assessing User Experience , 2018, 2018 IEEE Games, Entertainment, Media Conference (GEM).

[2]  Pieter Desmet,et al.  Measuring Emotion: Development and Application of an Instrument to Measure Emotional Responses to Products , 2005, Funology.

[3]  J. J. Jacobs,et al.  When a Car Makes You Smile: Development and Application of an Instrument to Measure Product Emotions , 2000 .

[4]  Rudy Hirschheim,et al.  Service-Oriented Architecture Maturity , 2011, Computer.

[5]  Csikszentmih Alyi,et al.  Flow and the Foundations of Positive Psychology , 2014 .

[6]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[7]  Virpi Roto,et al.  Understanding, scoping and defining user experience: a survey approach , 2009, CHI.

[8]  Michael Burmester,et al.  AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität , 2003, MuC.

[9]  Harith Alani,et al.  Evaluation Datasets for Twitter Sentiment Analysis: A survey and a new dataset, the STS-Gold , 2013, ESSEM@AI*IA.

[10]  J. Russell A circumplex model of affect. , 1980 .

[11]  Silvana Neumann Martins,et al.  Os princípios das metodologias ativas de ensino: uma abordagem teórica , 2017 .

[12]  R. Renken,et al.  Evoked Emotions Predict Food Choice , 2014, PloS one.

[13]  M. Csíkszentmihályi,et al.  The Experience Sampling Method , 2014 .

[14]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[15]  Virpi Roto,et al.  User experience evaluation methods: current state and development needs , 2010, NordiCHI.

[16]  Maria Cecília Calani Baranauskas,et al.  Exploring new formats of the Self-Assessment Manikin in the design with children , 2016, IHC.

[17]  G. A. Mendelsohn,et al.  Affect grid : A single-item scale of pleasure and arousal , 1989 .

[18]  Anne Marsden,et al.  International Organization for Standardization , 2014 .

[19]  Ping Dong,et al.  Romantic Crushes Promote Variety‐Seeking Behavior , 2018, Journal of Consumer Psychology.

[20]  Rosa M. Carro,et al.  Sentiment analysis in Facebook and its application to e-learning , 2014, Comput. Hum. Behav..

[21]  Camila Loiola Brito Maia,et al.  A Systematic Review About User Experience Evaluation , 2016, HCI.

[22]  Benjamin C. Heddy,et al.  Affordances of using mobile technology to support experience-sampling method in examining college students' engagement , 2019, Comput. Educ..

[23]  Elizabeth Furtado,et al.  How Do Users Express Their Emotions Regarding the Social System in Use? A Classification of Their Postings by Using the Emotional Analysis of Norman , 2014, HCI.

[24]  Artur Henrique Kronbauer,et al.  A new approach to identifying the potentialities of User Experience techniques , 2018, WebMedia.

[25]  Andrew May,et al.  The impact of user- and system-initiated personalization on the user experience at large sports events. , 2016, Applied ergonomics.

[26]  Kim Schouten,et al.  Survey on Aspect-Level Sentiment Analysis , 2016, IEEE Transactions on Knowledge and Data Engineering.

[27]  Tayana Conte,et al.  A Systematic Mapping Study on Research Contributions on UX Evaluation Technologies , 2017, IHC.