Study on the usage feasibility of continuous-wave radar for emotion recognition

Abstract Non-contact vital signs monitoring has a wide range of applications, such as in safe drive and in health care. In mental health care, the use of non-invasive signs holds a great potential, as it would likely enhance the patient's adherence to the use of objective measures to assess their emotional experiences, hence allowing for more individualized and efficient diagnoses and treatment. In order to evaluate the possibility of emotion recognition using a non-contact system for vital signs monitoring, we herein present a continuous wave radar based on the respiratory signal acquisition. An experimental set up was designed to acquire the respiratory signal while participants were watching videos that elicited different emotions (fear, happiness and a neutral condition). Signal was registered using a radar-based system and a standard certified equipment. The experiment was conducted to validate the system at two levels: the signal acquisition and the emotion recognition levels. Vital sign was analysed and the three emotions were identified using different classification algorithms. Furthermore, the classifier performance was compared, having in mind the signal acquired by both systems. Three different classification algorithms were used: the support-vector machine, K-nearest neighbour and the Random Forest. The achieved accuracy rates, for the three-emotion classification, were within 60% and 70%, which indicates that it is indeed possible to evaluate the emotional state of an individual using vital signs detected remotely.

[1]  A. Manstead,et al.  Social functions of emotion , 2008 .

[2]  J. Panksepp Affective Neuroscience: The Foundations of Human and Animal Emotions , 1998 .

[3]  Lisa Feldman Barrett,et al.  Emotions are real. , 2012, Emotion.

[4]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[5]  Nico H. Frijda,et al.  Emotion Experience and its Varieties , 2009 .

[6]  Yang Zhang,et al.  The Separation of the Heartbeat and Respiratory Signal of a Doppler Radar Based on the LMS Adaptive Harmonic Cancellation Algorithm , 2013, 2013 Sixth International Symposium on Computational Intelligence and Design.

[7]  Stephan Sigg,et al.  Applicability of RF-based methods for emotion recognition: A survey , 2016, 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[8]  Xiaohua Zhu,et al.  Non-Contact Emotion Recognition via CW Doppler Radar , 2018, 2018 Asia-Pacific Microwave Conference (APMC).

[9]  Lesya Anishchenko,et al.  Mental stress detection using bioradar respiratory signals , 2018, Biomed. Signal Process. Control..

[10]  K. Scherer What are emotions? And how can they be measured? , 2005 .

[11]  V. L. Clark,et al.  Clinical Methods: The History, Physical, and Laboratory Examinations , 1990 .

[12]  Lesya Anishchenko,et al.  Challenges and Potential Solutions of Psychophysiological State Monitoring with Bioradar Technology , 2018, Diagnostics.

[13]  Olga Boric-Lubecke,et al.  Blind Separation of Human Heartbeats and Breathing by the use of a Doppler Radar Remote Sensing , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[14]  Jacqueline Ferreira,et al.  Emotional Body Odors as Context: Effects on Cardiac and Subjective Responses , 2018, Chemical senses.

[15]  Pedro Pinho,et al.  A Review on Methods for Random Motion Detection and Compensation in Bio-Radar Systems , 2019, Sensors.

[16]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[17]  Vipin Kumar,et al.  Introduction to Data Mining , 2022, Data Mining and Machine Learning Applications.

[18]  Monique A M Smeets,et al.  A Sniff of Happiness , 2015, Psychological science.

[19]  Fadel Adib,et al.  Emotion recognition using wireless signals , 2016, MobiCom.

[20]  J. Gross,et al.  The up- and down-regulation of amusement: experiential, behavioral, and autonomic consequences. , 2008, Emotion.

[21]  Naeem Ramzan,et al.  DREAMER: A Database for Emotion Recognition Through EEG and ECG Signals From Wireless Low-cost Off-the-Shelf Devices , 2018, IEEE Journal of Biomedical and Health Informatics.