Multi-Modal Biological Driver Monitoring via Ubiquitous Wearable Body Sensor Network

The objective of this paper is to introduce the design of the next generation driver monitoring platform to be facilitated in the semi-autonomous automotive system infrastructure. In the context of connected vehicles, this work extends current infrastructure to include real-time driver monitoring and feedback. Rather than leaving the driver out of the process, the goal is to obtain a vehicle where the degree of autonomy is continuously changed in real-time as a function of uncertainty ranges for driver biological state and behavior. The evolution and dissemination of mobile technology has created exceptional opportunities for highly detailed and personalized data collection in a far more granular and cost effective way. However, turning this potential into practice requires algorithms and methodologies to transform these raw data into actionable information. We have developed a robust driver monitoring platform consisting of automotive sensors (i.e. OBD-II) that capture the real-time information of the vehicle and driving behavior as well as a heterogeneous wearable body sensor network that collects the driver biometrics (e.g., electroencephalography (EEG) and electrocardiogram (ECG)). Accurate synchronization and storage of such multi-source heterogeneous data were also developed and validated. Finally, The task of characterizing driver distraction using EEG signals was investigated in two different road conditions as a proof of concept.

[1]  Prabir Bhattacharya,et al.  A driver fatigue recognition model using fusion of multiple features , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[2]  O. H. Schmitt,et al.  Cardiovascular stress (electrocaridographic changes) produced by driving an automobile. , 1968, American heart journal.

[3]  Wan-Young Chung,et al.  A Smartphone-Based Driver Safety Monitoring System Using Data Fusion , 2012, Sensors.

[4]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[5]  Chin-Teng Lin,et al.  EEG-based brain dynamics of driving distraction , 2011, The 2011 International Joint Conference on Neural Networks.

[6]  T. Sejnowski,et al.  Removing electroencephalographic artifacts by blind source separation. , 2000, Psychophysiology.

[7]  Martin L. Griss,et al.  Activity-Aware Mental Stress Detection Using Physiological Sensors , 2010, MobiCASE.

[8]  Lubomir Pousek,et al.  Fatigue Indicators of Drowsy Drivers Based on Analysis of Physiological Signals , 2001, ISMDA.

[9]  Huachun Tan,et al.  Detecting eye blink states by tracking iris and eyelids , 2006, Pattern Recognition Letters.

[10]  Roman Rosipal,et al.  EEG-Based Drivers' Drowsiness Monitoring Using a Hierarchical Gaussian Mixture Model , 2007, HCI.

[11]  Yang Zhang,et al.  CarTel: a distributed mobile sensor computing system , 2006, SenSys '06.

[12]  R. S. Lynch,et al.  Anger, aggression, and risky behavior: a comparison of high and low anger drivers. , 2003, Behaviour research and therapy.

[13]  Dot Hs,et al.  Human Factors Evaluation of Level 2 And Level 3 Automated Driving Concepts Past Research, State of Automation Technology, and Emerging System Concepts , 2014 .

[14]  Stephen J. Buckley,et al.  AN AUTOMOBILE-INTEGRATED SYSTEM FOR ASSESSING AND REACTING TO DRIVER COGNITIVE LOAD , 2002 .

[15]  Javier Guerra-Casanova,et al.  Real-Time Stress Detection by Means of Physiological Signals , 2011 .

[16]  Ye Sun,et al.  An Innovative Nonintrusive Driver Assistance System for Vital Signal Monitoring , 2014, IEEE Journal of Biomedical and Health Informatics.

[17]  Gert Cauwenberghs,et al.  Wireless dry EEG for drowsiness detection , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  G. Underwood,et al.  Anger while driving , 1999 .