Emotion monitor - concept, construction and lessons learned

This paper concerns the design and physical construction of an emotion monitor stand for tracking human emotions in Human-Computer Interaction using multi-modal approach. The concept of the stand using cameras, behavioral analysis tools and a set of physiological sensors such as galvanic skin response, blood-volume pulse, temperature, breath and electromyography is presented and followed by details of Emotion Monitor construction at Gdansk University of Technology. Some experiments are reported that were already held at the stand, providing observations on reliability, accuracy and value the stand might provide in human-systems interaction evaluation. The lessons learned at this particular stand might be interesting for the other researchers aiming at emotion monitoring in human-systems interaction.

[1]  Elsevier Sdol.  International Journal of Human-Computer Studies , 2009 .

[2]  Michal R. Wróbel,et al.  Emotions in the software development process , 2013, 2013 6th International Conference on Human System Interactions (HSI).

[3]  Huan Su Ling,et al.  Emotion detection using keywords spotting and semantic network IEEE ICOCI 2006 , 2006, 2006 International Conference on Computing & Informatics.

[4]  Agnieszka Landowska,et al.  System supporting behavioral therapy for children with autism , 2015 .

[5]  Luca Chittaro,et al.  Affective computing vs. affective placebo: Study of a biofeedback-controlled game for relaxation training , 2014, Int. J. Hum. Comput. Stud..

[6]  Richard L. Hazlett,et al.  Measuring emotional valence to understand the user's experience of software , 2007, Int. J. Hum. Comput. Stud..

[7]  Veikko Surakka,et al.  The effects of affective interventions in human-computer interaction , 2004, Interact. Comput..

[8]  Björn W. Schuller,et al.  Categorical and dimensional affect analysis in continuous input: Current trends and future directions , 2013, Image Vis. Comput..

[9]  Hatice Gunes,et al.  Affect recognition from face and body: early fusion vs. late fusion , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[10]  Wioleta Szwoch,et al.  Emotion recognition and its application in software engineering , 2013, 2013 6th International Conference on Human System Interactions (HSI).

[11]  Maria E. Jabon,et al.  Real-time classification of evoked emotions using facial feature tracking and physiological responses , 2008, Int. J. Hum. Comput. Stud..

[12]  Eva Cerezo,et al.  Scalable multimodal fusion for continuous affect sensing , 2011, 2011 IEEE Workshop on Affective Computational Intelligence (WACI).

[13]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Wioleta Szwoch,et al.  Methodology of Affective Intervention Design for Intelligent Systems , 2016, Interact. Comput..

[15]  Agata Kolakowska,et al.  A review of emotion recognition methods based on keystroke dynamics and mouse movements , 2013, 2013 6th International Conference on Human System Interactions (HSI).

[16]  Szwoch Wioleta,et al.  Using physiological signals for emotion recognition , 2013, 2013 6th International Conference on Human System Interactions (HSI).

[17]  Haji Binali,et al.  A new significant area: Emotion detection in E-learning using opinion mining techniques , 2009, 2009 3rd IEEE International Conference on Digital Ecosystems and Technologies.

[18]  Björn W. Schuller,et al.  New Avenues in Opinion Mining and Sentiment Analysis , 2013, IEEE Intelligent Systems.

[19]  M. Jędrzejewska-Szczerska,et al.  Selection of physiological parameters for optoelectronic system supporting behavioral therapy of autistic children , 2014, Other Conferences.

[20]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Agnieszka Landowska,et al.  Affective reactions to playing digital games , 2015, 2015 8th International Conference on Human System Interaction (HSI).

[22]  Agnieszka Landowska,et al.  EMOTION MONITORING - VERIFICATION OF PHYSIOLOGICAL CHARACTERISTICS MEASUREMENT PROCEDURES , 2014 .

[23]  Affective computing and affective learning – methods, tools and prospects , 2013 .

[24]  Rosalind W. Picard,et al.  Evaluating affective interactions: Alternatives to asking what users feel , 2005 .