Towards hybrid driver state monitoring: Review, future perspectives and the role of consumer electronics

The purpose of this paper is to bring together multiple literature sources which present innovative methodologies for the assessment of driver state, driving context and performance by means of technology within a vehicle and consumer electronic devices. It also provides an overview of ongoing research and trends in the area of driver state monitoring. As part of this review a model of a hybrid driver state monitoring system is proposed. The model incorporates technology within a vehicle and multiple brought-in devices for enhanced validity and reliability of recorded data. Additionally, the model draws upon requirement of data fusion in order to generate unified driver state indicator(-s) that could be used to modify in-vehicle information and safety systems hence, make them driver state adaptable. Such modification could help to reach optimal driving performance in a particular driving situation. To conclude, we discuss the advantages of integrating hybrid driver state monitoring system into a vehicle and suggest future areas of research.

[1]  Shaibal Barua,et al.  Intelligent Driver Mental State Monitoring System Using Physiological Sensor Signals , 2015 .

[2]  Dick de Waard,et al.  Monitoring drivers' mental workload in driving simulators using physiological measures. , 2010, Accident; analysis and prevention.

[3]  Thomas A. Ranney,et al.  The effects of in-vehicle distraction on driver response during a crucial driving maneuver , 1999 .

[4]  Thomas J Triggs,et al.  Driver distraction: the effects of concurrent in-vehicle tasks, road environment complexity and age on driving performance. , 2006, Accident; analysis and prevention.

[5]  E M Rantanen,et al.  The effect of mental workload on the visual field size and shape. , 1999, Ergonomics.

[6]  Catherine Berthelon,et al.  Mental workload and driving , 2014, Front. Psychol..

[7]  Yorgos Goletsis,et al.  Towards Driver's State Recognition on Real Driving Conditions , 2011 .

[8]  John D. Lee,et al.  Real-Time Detection of Driver Cognitive Distraction Using Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[9]  T. Åkerstedt,et al.  Report on methods and classification of stress, inattention and emotional states , 2004 .

[10]  Wan-Young Chung,et al.  A Smartphone-Based Driver Safety Monitoring System Using Data Fusion , 2012, Sensors.

[11]  Yuan-Hsiang Lin,et al.  A Driver's Physiological Monitoring System Based on a Wearable PPG Sensor and a Smartphone , 2011, SUComS.

[12]  Narendra Nath Joshi,et al.  Driver fatigue detection system , 2016, 2016 IEEE International Conference on Signal and Image Processing (ICSIP).

[13]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[14]  Mohan M. Trivedi,et al.  Driving style recognition using a smartphone as a sensor platform , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[15]  William Brown,et al.  Psychology and life , 1934 .

[16]  Serge Boverie,et al.  Diagnostic fusion for in vehicle Driver vigilance assessment , 2008 .

[17]  Keiichi Uchimura,et al.  Driver Inattention Monitoring System for Intelligent Vehicles: A Review , 2009, IEEE Transactions on Intelligent Transportation Systems.

[18]  Shahina Begum,et al.  Intelligent driver monitoring systems based on physiological sensor signals: A review , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[19]  Michael Oehl,et al.  Introducing a multivariate model for predicting driving performance: the role of driving anger and personal characteristics. , 2013, Journal of safety research.

[20]  R J Fairbanks,et al.  RESEARCH ON VEHICLE-BASED DRIVER STATUS/PERFORMANCE MONITORING; DEVELOPMENT, VALIDATION, AND REFINEMENT OF ALGORITHMS FOR DETECTION OF DRIVER DROWSINESS. FINAL REPORT , 1994 .

[21]  D de Waard,et al.  Assessing driver status: a demonstration experiment on the road. , 1991, Accident; analysis and prevention.

[22]  J. Horne,et al.  Vehicle accidents related to sleep: a review. , 1999, Occupational and environmental medicine.

[23]  Dick de Waard,et al.  The measurement of drivers' mental workload , 1996 .

[24]  Susanne Gustafsson,et al.  ELECTROOCULOGRAM ANALYSIS AND DEVELOPMENT OF A SYSTEM FOR DEFINING STAGES OF DROWSINESS: MASTER'S THESIS PROJECT IN BIOMEDICAL ENGINEERING, REPRINT FROM LINKOEPING UNIVERSITY, DEPT. BIOMEDICAL ENGINEERING, LIU-IMT-EX-351, LINKOEPING 2003 , 2004 .

[25]  Björn W. Schuller,et al.  Emotion on the Road - Necessity, Acceptance, and Feasibility of Affective Computing in the Car , 2010, Adv. Hum. Comput. Interact..

[26]  Marthinus J. Booysen,et al.  Survey of smartphone-based sensing in vehicles for intelligent transportation system applications , 2015 .

[27]  Björn W. Schuller,et al.  On the Necessity and Feasibility of Detecting a Driver's Emotional State While Driving , 2007, ACII.

[28]  Terry C Lansdown,et al.  Distraction from multiple in-vehicle secondary tasks: vehicle performance and mental workload implications , 2004, Ergonomics.

[29]  Santokh Singh,et al.  Critical Reasons for Crashes Investigated in the National Motor Vehicle Crash Causation Survey , 2015 .

[30]  A. Craig,et al.  A critical review of the psychophysiology of driver fatigue , 2001, Biological Psychology.

[31]  Jürgen Valldorf,et al.  The ConnectedDrive Context Server – flexible Software Architecture for a Context Aware Vehicle , 2007 .

[32]  C. Ahlstrom,et al.  Measuring Driver Impairments: Sleepiness, Distraction, and Workload , 2012, IEEE Pulse.

[33]  Hamidur Rahman,et al.  Driver Monitoring in the Context of Autonomous Vehicle , 2015, SCAI.

[34]  Michael J. Goodman,et al.  NHTSA DRIVER DISTRACTION RESEARCH: PAST, PRESENT, AND FUTURE , 2001 .

[35]  G. Rigoll,et al.  The BMW SURF Project: A Contribution to the Research on Cognitive Vehicles , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[36]  K. A. Brookhuis.  Detection, tutoring and enforcement of traffic rules violations-The DETER project , 1993, Proceedings of VNIS '93 - Vehicle Navigation and Information Systems Conference.

[37]  Yorgos Goletsis,et al.  A wearable system for the affective monitoring of car racing drivers during simulated conditions , 2011 .

[38]  Hermann Winner,et al.  Three Decades of Driver Assistance Systems: Review and Future Perspectives , 2014, IEEE Intelligent Transportation Systems Magazine.