An exploratory study of detecting emotion states using eye-tracking technology

Studying eye movement has proven to be useful in the study of detecting and understanding human emotional states. This paper aims to investigate eye movement features: pupil size, time of first fixation, first fixation duration, fixation duration and fixation count in clips emotional stimulation. Thirty seven subjects' pupil responses were measured while watching two pleasant and unpleasant emotional clips. The results showed that the fixation duration and fixation count significantly different between pleasant and unpleasant clip arousal. These results suggest that the measurement of eye fixation may be a potentially useful computer input for detecting positive and negative emotional state.

[1]  Mohamed Chetouani,et al.  Hilbert-Huang transform based physiological signals analysis for emotion recognition , 2009, 2009 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[2]  M. Bradley,et al.  The pupil as a measure of emotional arousal and autonomic activation. , 2008, Psychophysiology.

[3]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[4]  Bao-Liang Lu,et al.  EEG-based emotion recognition during watching movies , 2011, 2011 5th International IEEE/EMBS Conference on Neural Engineering.

[5]  Veikko Surakka,et al.  Pupil size variation as an indication of affective processing , 2003, Int. J. Hum. Comput. Stud..

[6]  R. Davidson,et al.  Manipulating affective state using extended picture presentations. , 1997, Psychophysiology.

[7]  Liang Zhang,et al.  The application of unascertained measure to the video emotion type recognition , 2010, 2010 2nd International Conference on Signal Processing Systems.

[8]  Gerald L. Lohse,et al.  Organizational Behavior and Human Decision Processes a Comparison of Two Process Tracing Methods for Choice Tasks , 2022 .

[9]  J Hyönä,et al.  Pupil Dilation as a Measure of Processing Load in Simultaneous Interpretation and Other Language Tasks , 1995, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[10]  Rosalind W. Picard.  Affective Computing: From Laughter to IEEE , 2010 .

[11]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[12]  Richard J. Davidson,et al.  Now You Feel It, Now You Don't , 2003, Psychological science.

[13]  P. Lang.  International Affective Picture System (IAPS) : Technical Manual and Affective Ratings , 1995 .

[14]  C. Izard,et al.  Emotion Knowledge as a Predictor of Social Behavior and Academic Competence in Children at Risk , 2001, Psychological science.

[15]  Michael Wagner,et al.  From Joyous to Clinically Depressed: Mood Detection Using Spontaneous Speech , 2012, FLAIRS.

[16]  Jonathan Klein,et al.  Frustrating the user on purpose: a step toward building an affective computer , 2002, Interact. Comput..

[17]  Alex Pentland,et al.  Human computing and machine understanding of human behavior: a survey , 2006, ICMI '06.

[18]  Veikko Surakka,et al.  Pupillary responses to emotionally provocative stimuli , 2000, ETRA.

[19]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  G. McConkie,et al.  Eye movements during reading: a theory of saccade initiation times , 2001, Vision Research.

[21]  R. P. Hobson,et al.  Emotion recognition in autism: coordinating faces and voices , 1988, Psychological Medicine.

[22]  Ilia Uma.  physiological signals based human emotion recognition a review , 2014 .

[23]  John J. B. Allen,et al.  The handbook of emotion elicitation and assessment , 2007 .