Emotion Recognition Using Physiological Signals: Laboratory vs. Wearable Sensors

Emotion recognition is an important research topic. Physiological signals seem to be an appropriate way for emotion recognition and specific sensors are required to collect these data. Therefore, laboratory sensors are commonly used while the number of wearable devices including similar physiological sensors is growing up. Many studies have been completed to evaluate the signal quality obtained by these sensors but without focusing on their emotion recognition capabilities. In the current study, Machine Learning models were trained to compare the Biopac MP150 (laboratory sensor) and Empatica E4 (wearable sensor) in terms of emotion recognition accuracy. Results show similar accuracy between data collected using laboratory and wearable sensors. These results support the reliability of emotion recognition outside laboratory.

[1]  J. Russell,et al.  An approach to environmental psychology , 1974 .

[2]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[3]  Craig A. Smith,et al.  Patterns of cognitive appraisal in emotion. , 1985, Journal of personality and social psychology.

[4]  Manfred Tscheligi,et al.  Guidelines for Mobile Emotion Measurement , 2009 .

[5]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[6]  Jason Bell,et al.  Machine Learning: Hands-On for Developers and Technical Professionals , 2014 .

[7]  Sylvie Charbonnier,et al.  A comparison of wearable and stationary sensors for stress detection , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[8]  A. Beck,et al.  Beck Depression Inventory–II , 2011 .

[9]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Rosalind W. Picard,et al.  Empatica E3 — A wearable wireless multi-sensor device for real-time computerized biofeedback and data acquisition , 2014, 2014 4th International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare Through Innovations in Mobile and Wireless Technologies (MOBIHEALTH).

[11]  Constantine Kotropoulos,et al.  Emotional speech recognition: Resources, features, and methods , 2006, Speech Commun..

[12]  Ilia Uma.  physiological signals based human emotion recognition a review , 2014 .

[13]  D. E. Berlyne.  Book reviewxii + 266 Pp. $12.50. Mehrabian A., Russell J.A., An Approach to Environmental Psychology, MIT Press, Cambridge, MA (1974) , 1976 .

[14]  Andy Adler,et al.  Validation of the Empatica E4 wristband , 2016, 2016 IEEE EMBS International Student Conference (ISC).

[15]  P. Lang.  International Affective Picture System (IAPS) : Technical Manual and Affective Ratings , 1995 .

[16]  C. Pelachaud,et al.  Emotion-Oriented Systems: The Humaine Handbook , 2011 .

[17]  Sylvia D. Kreibig,et al.  Autonomic nervous system activity in emotion: A review , 2010, Biological Psychology.