UDSP+: stress detection based on user-reported emotional ratings and wearable skin conductance sensor

Detecting stress during user experience (UX) evaluation is particularly important. Studies have shown that skin conductance (SC) is a physiological signal highly associated with stress. This paper investigates how SC Responses (SCRs) can contribute to the development of a publicly available stress detection mechanism. In specific, SCRs located in users' self-reported stress periods were used as a training dataset for the creation of our UDSP+ predictor. A lab study was conducted to evaluate the accuracy of our approach. The SC of 24 participants was recorded using the wearable Nexus10 sensor. Moreover, participants' self-reported emotional ratings (valence-arousal) were obtained using the Affect Grid Tool retrospectively. The performance of the UDSP+ was tested using machine learning. Considering the 2-class classification problem (stress vs. non-stress), an accuracy of up to 86% was achieved. This demonstrates the dynamics of users' self-reported periods to act as a dataset creation mechanism in tow with SCRs.

[1]  W. Boucsein.  Electrodermal activity, 2nd ed. , 2012 .

[2]  Emre Ertin,et al.  cStress: towards a gold standard for continuous stress assessment in the mobile environment , 2015, UbiComp.

[3]  Masaaki Kurosu.  Human-Computer Interaction. Advanced Interaction Modalities and Techniques , 2014, Lecture Notes in Computer Science.

[4]  Jin-Hyuk Hong,et al.  Understanding physiological responses to stressors during physical activity , 2012, UbiComp.

[5]  Michalis Nik Xenos,et al.  Subjective Assessment of Stress in HCI: A Study of the Valence-Arousal Scale using Skin Conductance , 2015, CHItaly.

[6]  Simon Harper,et al.  Using galvanic skin response measures to identify areas of frustration for older web 2.0 users , 2010, W4A.

[7]  J. Lagopoulos.  Electrodermal activity , 2007, Acta Neuropsychiatrica.

[8]  A. L. Jacobson,et al.  Auto-threshold peak detection in physiological signals , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  Regan L. Mandryk,et al.  A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies , 2007, Int. J. Hum. Comput. Stud..

[10]  Linden J. Ball,et al.  Cueing retrospective verbal reports in usability testing through eye-movement replay , 2007, BCS HCI.

[11]  Didem Gökçay,et al.  Stress Detection in Human–Computer Interaction: Fusion of Pupil Dilation and Facial Temperature Features , 2016, Int. J. Hum. Comput. Interact..

[12]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[13]  Willem Verbeke,et al.  Using the job demands‐resources model to predict burnout and performance , 2004 .

[14]  Eun-Hyun Lee,et al.  Review of the psychometric evidence of the perceived stress scale. , 2012, Asian nursing research.

[15]  Ross Teague,et al.  Concurrent vs. post-task usability test ratings , 2001, CHI Extended Abstracts.

[16]  Harry Hochheiser,et al.  Research Methods for Human-Computer Interaction , 2008 .

[17]  Adrian Basarab,et al.  Towards an automatic early stress recognition system for office environments based on multimodal measurements: A review , 2016, J. Biomed. Informatics.

[18]  M. Kivimäki,et al.  Work stress in the etiology of coronary heart disease--a meta-analysis. , 2006, Scandinavian journal of work, environment & health.

[19]  Michalis Nik Xenos,et al.  Recognizing Emotions in Human Computer Interaction: Studying Stress Using Skin Conductance , 2015, INTERACT.

[20]  Gerhard Tröster,et al.  Discriminating Stress From Cognitive Load Using a Wearable EDA Device , 2010, IEEE Transactions on Information Technology in Biomedicine.

[21]  Anders Bruun,et al.  Understanding the Relationship between Frustration and the Severity of Usability Problems: What can Psychophysiological Data (Not) Tell Us? , 2016, CHI.

[22]  Michalis Nik Xenos,et al.  Evaluating User's Emotional Experience in HCI: The PhysiOBS Approach , 2014, HCI.

[23]  Michalis Nik Xenos,et al.  Stress in interactive applications: analysis of the valence-arousal space based on physiological signals and self-reported data , 2016, Multimedia Tools and Applications.

[24]  M. Angela Sasse,et al.  Do Users Always Know What's Good For Them? Utilising Physiological Responses to Assess Media Quality , 2000, BCS HCI.

[25]  Matjaz Gams,et al.  Continuous stress detection using a wrist device: in laboratory and real life , 2016, UbiComp Adjunct.

[26]  G. A. Mendelsohn,et al.  Affect grid : A single-item scale of pleasure and arousal , 1989 .