Bio-signal based emotion detection device

In the past several years, significant research has been conducted in the area of real-time emotion recognition. Emotion recognition has several potential applications in education, medicine, assistive technologies and human-machine interaction. A real-time emotion detection device that utilizes heart rate and skin conductance sensors is presented in this paper. OpenCV, open face libraries and insight SDK is utilized to detect emotions from facial expressions. The performance of the device is evaluated using experiments which had subjects watch audiovisual clips in various emotional categories. Also, in order to verify the feasibility of utilizing bio-signals to predict emotions, facial expressions captured from a webcam are processed in parallel to compare and contrast.

[1]  J. Gross,et al.  Hiding feelings: the acute effects of inhibiting negative and positive emotion. , 1997, Journal of abnormal psychology.

[2]  N. Nagaratnam,et al.  Motor neurone disease , 1972, Journal of Neurology.

[3]  P. Lang.  The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[4]  Yuan Gu,et al.  Emotion-aware technologies for consumer electronics , 2008, 2008 IEEE International Symposium on Consumer Electronics.

[5]  Bhanu Kapoor,et al.  Intelligent data analysis algorithms on biofeedback signals for estimating emotions , 2014, 2014 International Conference on Reliability Optimization and Information Technology (ICROIT).

[6]  M Murugappan,et al.  Physiological signals based human emotion Recognition: a review , 2011, 2011 IEEE 7th International Colloquium on Signal Processing and its Applications.

[7]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[8]  T. Dalgleish.  Basic Emotions , 2004 .

[9]  K. Talbot,et al.  Motor neurone disease , 2002, Postgraduate medical journal.

[10]  U. Wijeratne,et al.  Intelligent emotion recognition system using electroencephalography and active shape models , 2012, 2012 IEEE-EMBS Conference on Biomedical Engineering and Sciences.

[11]  Rosalind W. Picard.  Affective Computing , 1997 .

[12]  Nicu Sebe,et al.  Authentic Emotion Detection in Real-Time Video , 2004, ECCV Workshop on HCI.

[13]  Olga Sourina,et al.  EEG-based Dominance Level Recognition for Emotion-Enabled Interaction , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[14]  Paul Richard,et al.  Emotion assessment for affective computing based on physiological responses , 2012, 2012 IEEE International Conference on Fuzzy Systems.