Wearable Mobile-Based Emotional Response-Monitoring System for Drivers

Negative emotional responses are a growing problem among drivers, particularly in countries with heavy traffic, and may lead to serious accidents on the road. Measuring stress- and fatigue-induced emotional responses by means of a wireless, wearable system would be useful for potentially averting roadway tragedies. The focus of this study was to develop and verify an emotional response-monitoring paradigm for drivers, derived from electromyography signals of the upper trapezius muscle, photoplethysmography signals of the earlobe, as well as inertial motion sensing of the head movement. The relevant sensors were connected to a microcontroller unit equipped with a Bluetooth-enabled low-energy module, which allows the transmission of those sensor readings to a mobile device in real time. A mobile device application was then used to extract the data from the sensors and to determine the driver's current emotion status, via a trained support vector machine (SVM). The emotional response paradigm, tested in ten subjects, consisted of 10 min baseline, 5 min prestimulus, and 5 min poststimulus measurements. Emotional responses were categorized into three classes: relaxed, stressed, and fatigued. The analysis integrated a total of 36 features to train the SVM model, and the final stimulus results revealed a high accuracy rate (99.52%). The proposed wearable system could be applied to an intelligent driver's safety alert system, to use those emotional responses to prevent accidents affecting themselves and/or other innocent victims.

[1]  I. Constant,et al.  Pulse rate variability is not a surrogate for heart rate variability. , 1999, Clinical science.

[2]  Rahul Banerjee,et al.  Detection of fatigue of vehicular driver using skin conductance and oximetry pulse: a neural network approach , 2009, iiWAS.

[3]  A. Papaioannou,et al.  Emotion and Stress , 1999, Neural Plasticity.

[4]  D. A. Suriamihardja,et al.  Sediment Texture and Topography Features Control on Coastal Morphodynamics State , 2017 .

[5]  Wan-Young Chung,et al.  Smartwatch-Based Driver Vigilance Indicator With Kernel-Fuzzy-C-Means-Wavelet Method , 2016, IEEE Sensors Journal.

[6]  Yang Shao,et al.  Comparison of support vector machine, neural network, and CART algorithms for the land-cover classification using limited training data points , 2012 .

[7]  Gang Li,et al.  Detection of Driver Drowsiness Using Wavelet Analysis of Heart Rate Variability and a Support Vector Machine Classifier , 2013, Sensors.

[8]  Jian-Jia Chen,et al.  Design and Implementation of Mobile Personal Emotion Monitoring System , 2009, 2009 Tenth International Conference on Mobile Data Management: Systems, Services and Middleware.

[9]  Goh Chia Chieh,et al.  Abnormal Driver Behavior Detection Using Parallel CPU and GPU Algorithm through Facial Expression , Thermal Imaging and Heart Rate Data Fusion , 2012 .

[10]  Gangyi Ding,et al.  A New Study on the Driver's Emotion Model , 2015, 2015 Fifth International Conference on Communication Systems and Network Technologies.

[11]  C. Sodini,et al.  The ear as a location for wearable vital signs monitoring , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[12]  Kyandoghere Kyamakya,et al.  A Novel Real-Time Emotion Detection System for Advanced Driver Assistance Systems , 2012, Autonomous Systems: Developments and Trends.

[13]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[14]  Anthony D. McDonald,et al.  Real-Time Detection of Drowsiness Related Lane Departures Using Steering Wheel Angle , 2012 .

[15]  Jens Sadowski,et al.  Comparison of Support Vector Machine and Artificial Neural Network Systems for Drug/Nondrug Classification , 2003, J. Chem. Inf. Comput. Sci..

[16]  R. Thayer.  The biopsychology of mood and arousal , 1989 .

[17]  Wentao Mao,et al.  Leave-one-out cross-validation-based model selection for multi-input multi-output support vector machine , 2012, Neural Computing and Applications.

[18]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[19]  Wan-Young Chung,et al.  Wristband-Type Driver Vigilance Monitoring System Using Smartwatch , 2015, IEEE Sensors Journal.

[20]  Enzo Pasquale Scilingo,et al.  How the Autonomic Nervous System and Driving Style Change With Incremental Stressing Conditions During Simulated Driving , 2015, IEEE Transactions on Intelligent Transportation Systems.

[21]  R. Lazarus.  From psychological stress to the emotions: a history of changing outlooks. , 1993, Annual review of psychology.

[22]  Gang Li,et al.  Smartwatch-Based Wearable EEG System for Driver Drowsiness Detection , 2015, IEEE Sensors Journal.

[23]  Wan-Young Chung,et al.  Mobile Healthcare for Automatic Driving Sleep-Onset Detection Using Wavelet-Based EEG and Respiration Signals , 2014, Sensors.

[24]  T. Sejnowski,et al.  Estimating alertness from the EEG power spectrum , 1997, IEEE Transactions on Biomedical Engineering.

[25]  Mark Euston,et al.  A complementary filter for attitude estimation of a fixed-wing UAV , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Anup V Desai,et al.  The utility of the AusEd driving simulator in the clinical assessment of driver fatigue , 2007, Behavior research methods.

[27]  Kyandoghere Kyamakya,et al.  Detecting human driver's physiological stress and emotions using sophisticated one-person cockpit vehicle simulator , 2015, 2015 Information Technologies in Innovation Business Conference (ITIB).

[28]  A. Esterman.  The Likert Scale , 2003 .

[29]  Myounghoon Jeon,et al.  Detection of Drivers' Incidental and Integral Affect Using Physiological Measures , 2013 .

[30]  Ing-Marie Jonsson,et al.  Detecting Emotions in Conversations Between Driver and In-Car Information Systems , 2005, ACII.

[31]  Julien Penders,et al.  Trapezius muscle EMG as predictor of mental stress , 2010, Wireless Health.

[32]  Abdul Wahab,et al.  Driver identification and driver's emotion verification using KDE and MLP neural networks , 2010, Proceeding of the 3rd International Conference on Information and Communication Technology for the Moslem World (ICT4M) 2010.

[33]  Jacques Bergeron,et al.  Monotony of road environment and driver fatigue: a simulator study. , 2003, Accident; analysis and prevention.

[34]  F. Fay Evans-Martin.  Emotion and Stress , 2007 .

[35]  Shahidan M. Abdullah,et al.  Advantage and drawback of support vector machine functionality , 2014, 2014 International Conference on Computer, Communications, and Control Technology (I4CT).

[36]  Abdullah Bin Queyam,et al.  Stress Detection in Automobile Drivers using Physiological Parameters: A Review , 2013 .

[37]  G. Matthews,et al.  Attentional Overload, stress, and simulate Driving Performance , 1996 .

[38]  Yisheng Zhu,et al.  A Preliminary Attempt to Understand Compatibility of Photoplethysmographic Pulse Rate Variability with Electrocardiogramic Heart Rate Variability , 2008 .

[39]  K. H. Kim,et al.  Emotion recognition system using short-term monitoring of physiological signals , 2004, Medical and Biological Engineering and Computing.

[40]  Richel Lousberg,et al.  Experimentally Induced Stress Validated by EMG Activity , 2014, PloS one.

[41]  M. Jeng,et al.  Driver fatigue and highway driving: A simulator study , 2008, Physiology & Behavior.

[42]  Masayoshi Tomizuka,et al.  An Overview on Study of Identification of Driver Behavior Characteristics for Automotive Control , 2014 .