Emotional Response Analysis Using Electrodermal Activity, Electrocardiogram and Eye Tracking Signals in Drivers With Various Car Setups

In the automotive industry, it is important to evaluate different car setups in order to match a professional driver’s preference or to match the most acceptable setup for most drivers. Therefore, it is of great significance to devise objective and automatic procedures to assess a driver’s response to different car settings. In this work, we analyze different physiological signals in order to evaluate how a particular car setup can be more or less stressful than others. In detail, we record an endosomatic Electrodermal Activity (EDA) signal, called Skin Potential Response (SPR), the Electrocardiogram (ECG) signal, and eye tracking coordinates. We eliminate motion artifacts by processing two SPR signals, one from each hand of the driver. Tests are carried out in a company that designs driving simulators, where the tested individuals had to drive along a straight highway with several lane changes. Three different car setups have been tested (neutral, understeering, and oversteering). We apply a statistical test to the data extracted from the cleaned SPR signal, and we then compare the results with the ones obtained using a Machine Learning algorithm. We show that we are able to discriminate the drivers’ response to each setup, and, in particular, that the base car setup generates the least intense emotional response when compared to the understeering and the oversteering car setups.

[1]  Lisa O'Donoghue-Lindy,et al.  New year, new publisher – Nordic occupational health association takes over reins of Scandinavian Journal of Work Environment & Health , 2013 .

[2]  Yu-Wen Huang,et al.  The influence of bus and taxi drivers' public self-consciousness and social anxiety on aberrant driving behaviors. , 2018, Accident; analysis and prevention.

[4]  Riccardo Bernardini,et al.  Car Driver's Sympathetic Reaction Detection Through Electrodermal Activity and Electrocardiogram Measurements , 2020, IEEE Transactions on Biomedical Engineering.

[5]  Yair Amichai-Hamburger,et al.  Technology and Psychological Well-being , 2011 .

[6]  Klas Ihme,et al.  Discriminating drivers’ emotions through the dimension of power: Evidence from facial infrared thermography and peripheral physiological measurements , 2019, Transportation Research Part F: Traffic Psychology and Behaviour.

[7]  Margherita Peruzzini,et al.  Transdisciplinary design approach based on driver's workload monitoring , 2019, J. Ind. Inf. Integr..

[8]  A. Backman,et al.  Health survey of professional drivers. , 1983, Scandinavian journal of work, environment & health.

[9]  Karla Conn Welch,et al.  A Review on Measuring Affect with Practical Sensors to Monitor Driver Behavior , 2019, Safety.

[10]  Riccardo Bernardini,et al.  Driver’s stress detection using Skin Potential Response signals , 2018, Measurement.

[11]  Brennan R. Payne,et al.  A Review of Psychophysiological Measures to Assess Cognitive States in Real-World Driving , 2019, Front. Hum. Neurosci..

[12]  Riccardo Bernardini,et al.  Low-Complexity Classification Algorithm to Identify Drivers’ Stress Using Electrodermal Activity (EDA) Measurements , 2018 .

[13]  A. Affanni Wearable instrument to measure simultaneously cardiac and electrodermal activities , 2016, 2016 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[14]  Christos D. Katsis,et al.  Toward Emotion Recognition in Car-Racing Drivers: A Biosignal Processing Approach , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[15]  Jangwoon Park,et al.  Identifying Traffic Context Using Driving Stress: A Longitudinal Preliminary Case Study , 2019, Sensors.

[16]  Jean-Michel Poggi,et al.  Self‐similarity analysis of vehicle driver's electrodermal activity , 2019, Qual. Reliab. Eng. Int..

[17]  A. Affanni,et al.  Motion artifact removal in stress sensors used in “driver in motion” simulators , 2016, 2016 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[18]  B Scott-Parker,et al.  A qualitative exploration of driving stress and driving discourtesy. , 2018, Accident; analysis and prevention.

[19]  Riccardo Bernardini,et al.  Stress Detection Through Electrodermal Activity (EDA) and Electrocardiogram (ECG) Analysis in Car Drivers , 2019, 2019 27th European Signal Processing Conference (EUSIPCO).

[20]  O. Ben-Ari,et al.  Driven by emotions: The association between emotion regulation, forgivingness, and driving styles , 2019, Transportation Research Part F: Traffic Psychology and Behaviour.

[21]  Chelsea Dobbins,et al.  Signal Processing of Multimodal Mobile Lifelogging Data Towards Detecting Stress in Real-World Driving , 2019, IEEE Transactions on Mobile Computing.

[22]  Antonio Affanni,et al.  Wireless Sensors System for Stress Detection by Means of ECG and EDA Acquisition , 2020, Sensors.

[23]  Antonio Affanni Dual channel electrodermal activity and an ECG wearable sensor to measure mental stress from the hands , 2019 .

[24]  Andry Rakotonirainy,et al.  Automatic driver stress level classification using multimodal deep learning , 2019, Expert Syst. Appl..

[25]  Riccardo Bernardini,et al.  Stress Evaluation in Simulated Autonomous and Manual Driving through the Analysis of Skin Potential Response and Electrocardiogram Signals , 2020, Sensors.

[26]  Zahid Halim,et al.  On identification of driving-induced stress using electroencephalogram signals: A framework based on wearable safety-critical scheme and machine learning , 2020, Inf. Fusion.

[27]  Wonjong Rhee,et al.  Characterizing Driver Stress Using Physiological and Operational Data from Real-World Electric Vehicle Driving Experiment , 2018 .