Identifying Psychophysiological Correlates of Boredom and Negative Mood Induced during HCI

This paper presents work conducted towards the automatic recognition of negative emotions like boredom and frustration, induced due to the subject’s loss of interest during HCI. Focus was on the basic pre-requisite for the future development of systems utilizing an “affective loop”, namely effective recognition of the human affective state. Based on the concept of “repetition that causes loss of interest”, an experiment for the monitoring and analysis of biosignals during repetitive HCI tasks was deployed. During this experiment, subjects were asked to play a simple labyrinth-based 3D video game repeatedly, while biosignals from different modalities were monitored. Twenty one different subjects participated in the experiment, allowing for a rich biosignals database to be populated. Statistically significant correlations were identified between features extracted from two of the modalities used in the experiment (ECG and GSR) and the actual affective state of the subjects.

[1]  A. Murat Tekalp,et al.  Multimedia Content Representation, Classification and Security, International Workshop, MRCS 2006, Istanbul, Turkey, September 11-13, 2006, Proceedings , 2006, MRCS.

[2]  Guillaume Chanel,et al.  Emotion Assessment: Arousal Evaluation Using EEG's and Peripheral Physiological Signals , 2006, MRCS.

[3]  Jeremy R. Cooperstock,et al.  Biosignals Analysis and its Application in a Performance Setting - Towards the Development of an Emotional-Imaging Generator , 2008, BIOSIGNALS.

[4]  H. Nagaraja,et al.  Heart rate variability: origins, methods, and interpretive caveats. , 1997, Psychophysiology.

[5]  K. H. Kim,et al.  Emotion recognition system using short-term monitoring of physiological signals , 2004, Medical and Biological Engineering and Computing.

[6]  J. Andreassi.  Psychophysiology: Human Behavior and Physiological Response , 1980 .

[7]  Petra Sundström,et al.  Exploring the Affective Loop , 2005 .

[8]  Guillaume Chanel,et al.  Boredom, engagement and anxiety as indicators for adaptation to difficulty in games , 2008, MindTrek '08.

[9]  Randolph R. Cornelius,et al.  The science of emotion: Research and tradition in the psychology of emotion. , 1997 .

[10]  A. Damasio,et al.  Basic emotions are associated with distinct patterns of cardiorespiratory activity. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[11]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Johannes Wagner,et al.  From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[13]  Mark S. Schwartz,et al.  Biofeedback: A Practitioner's Guide , 1987 .

[14]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[16]  Regan L. Mandryk,et al.  A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies , 2007, Int. J. Hum. Comput. Stud..

[17]  Jason Williams,et al.  Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System , 2004, ADS.