Associating Vehicles Automation With Drivers Functional State Assessment Systems: A Challenge for Road Safety in the Future

In the near future, vehicles will gradually gain more autonomous functionalities. Drivers’ activity will be less about driving than about monitoring intelligent systems to which driving action will be delegated. Road safety, therefore, remains dependent on the human factor and we should identify the limits beyond which driver’s functional state (DFS) may no longer be able to ensure safety. Depending on the level of automation, estimating the DFS may have different targets, e.g., assessing driver’s situation awareness in lower levels of automation and his ability to respond to emerging hazard or assessing driver’s ability to monitor the vehicle performing operational tasks in higher levels of automation. Unfitted DFS (e.g., drowsiness) may impact the driver ability respond to taking over abilities. This paper reviews the most appropriate psychophysiological indices in naturalistic driving while considering the DFS through exogenous sensors, providing the more efficient trade-off between reliability and intrusiveness. The DFS also originates from kinematic data of the vehicle, thus providing information that indirectly relates to drivers behavior. The whole data should be synchronously processed, providing a diagnosis on the DFS, and bringing it to the attention of the decision maker in real time. Next, making the information available can be permanent or intermittent (or even undelivered), and may also depend on the automation level. Such interface can include recommendations for decision support or simply give neutral instruction. Mapping of relevant psychophysiological and behavioral indicators for DFS will enable practitioners and researchers provide reliable estimates, fitted to the level of automation.

[1]  Sai Chand,et al.  Autonomous Vehicles: Disengagements, Accidents and Reaction Times , 2016, PloS one.

[2]  Ranjana K. Mehta,et al.  Neuroergonomics: a review of applications to physical and cognitive work , 2013, Front. Hum. Neurosci..

[3]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[4]  William J. Horrey,et al.  Automated driving: Safety blind spots , 2018 .

[5]  V V Dementienko,et al.  Automatic checkout systems to monitor driver's vigilance. , 2001, Critical reviews in biomedical engineering.

[6]  Pablo Laguna,et al.  Drowsiness detection using heart rate variability , 2016, Medical & Biological Engineering & Computing.

[7]  S. Porges Orienting in a defensive world: mammalian modifications of our evolutionary heritage. A Polyvagal Theory. , 1995, Psychophysiology.

[8]  Eric T. Greenlee,et al.  Driver Vigilance in Automated Vehicles: Hazard Detection Failures Are a Matter of Time , 2018, Hum. Factors.

[9]  C. Gehin,et al.  Wrist ambulatory monitoring system and smart glove for real time emotional, sensorial and physiological analysis , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  R. Fuller Towards a general theory of driver behaviour. , 2005, Accident; analysis and prevention.

[11]  Klaus Bengler,et al.  Taking Over Control From Highly Automated Vehicles in Complex Traffic Situations , 2016, Hum. Factors.

[12]  Eric McAdams,et al.  An integrated device to evaluate a driver’s functional state , 2009, Behavior research methods.

[13]  Neville A. Stanton,et al.  Effects of adaptive cruise control and highly automated driving on workload and situation awareness: A review of the empirical evidence , 2014 .

[14]  Mark S. Young,et al.  Malleable Attentional Resources Theory: A New Explanation for the Effects of Mental Underload on Performance , 2002, Hum. Factors.

[15]  Catherine Neubauer,et al.  Fatigue and Voluntary Utilization of Automation in Simulated Driving , 2012, Hum. Factors.

[16]  Yorgos Goletsis,et al.  Towards Driver's State Recognition on Real Driving Conditions , 2011 .

[17]  Kenneth Hugdahl,et al.  Cognitive influences on human autonomic nervous system function , 1996, Current Opinion in Neurobiology.

[18]  Kenneth Sundaraj,et al.  Detecting Driver Drowsiness Based on Sensors: A Review , 2012, Sensors.

[19]  Kathrin Zeeb,et al.  Is take-over time all that matters? The impact of visual-cognitive load on driver take-over quality after conditionally automated driving. , 2016, Accident; analysis and prevention.

[20]  Andrej Ivanco,et al.  Fleet analysis of headway distance for autonomous driving. , 2017, Journal of safety research.

[21]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[22]  N A Stanton,et al.  What's skill got to do with it? Vehicle automation and driver mental workload , 2007, Ergonomics.

[23]  Natasha Merat,et al.  Behavioural changes in drivers experiencing highly-automated vehicle control in varying traffic conditions , 2013 .

[24]  C. Collet,et al.  Stroop color–word test, arousal, electrodermal activity and performance in a critical driving situation , 2005, Biological Psychology.

[25]  Chrysoula Kourtidou-Papadeli,et al.  Monitoring sleepiness with on-board electrophysiological recordings for preventing sleep-deprived traffic accidents , 2007, Clinical Neurophysiology.

[26]  Enzo Pasquale Scilingo,et al.  How the Autonomic Nervous System and Driving Style Change With Incremental Stressing Conditions During Simulated Driving , 2015, IEEE Transactions on Intelligent Transportation Systems.

[27]  J. Dorrian,et al.  The driver vigilance telemetric control system (DVTCS): Investigating sensitivity to experimentally induced sleep loss and fatigue , 2008, Behavior research methods.

[28]  Bryan Reimer,et al.  Sensitivity of Physiological Measures for Detecting Systematic Variations in Cognitive Demand From a Working Memory Task , 2012, Hum. Factors.

[29]  Jens Reermann,et al.  Detection of steering direction using EEG recordings based on sample entropy and time-frequency analysis , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[30]  Mohammad Mikaeili,et al.  Driving Drowsiness Detection Using Fusion of Electroencephalography, Electrooculography, and Driving Quality Signals , 2016, Journal of medical signals and sensors.

[31]  Lingguo Bu,et al.  Vigilance Task-Related Change in Brain Functional Connectivity as Revealed by Wavelet Phase Coherence Analysis of Near-Infrared Spectroscopy Signals , 2016, Front. Hum. Neurosci..

[32]  Kwang Suk Park,et al.  Nonintrusive Biosignal Measurement System in a Vehicle , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[33]  Chun-Hsiang Chuang,et al.  Wireless and Wearable EEG System for Evaluating Driver Vigilance , 2014, IEEE Transactions on Biomedical Circuits and Systems.

[34]  Neville A. Stanton,et al.  Take-Over Time in Highly Automated Vehicles , 2018, Driver Reactions to Automated Vehicles.

[35]  Josef F. Krems,et al.  Workload-adaptive cruise control – A new generation of advanced driver assistance systems , 2013 .

[36]  M. Mitchell Waldrop,et al.  Autonomous vehicles: No drivers required , 2015, Nature.

[37]  Ye Sun,et al.  An Innovative Nonintrusive Driver Assistance System for Vital Signal Monitoring , 2014, IEEE Journal of Biomedical and Health Informatics.

[38]  T A Ranney,et al.  Models of driving behavior: a review of their evolution. , 1994, Accident; analysis and prevention.

[39]  Gang Li,et al.  Detection of Driver Drowsiness Using Wavelet Analysis of Heart Rate Variability and a Support Vector Machine Classifier , 2013, Sensors.

[40]  Tao Liu,et al.  Near-infrared spectroscopy as a tool for driving research , 2016, Ergonomics.

[41]  Dick de Waard,et al.  Monitoring drivers' mental workload in driving simulators using physiological measures. , 2010, Accident; analysis and prevention.

[42]  Rongrong Fu,et al.  Detection of Driving fatigue by using Noncontact EMG and ECG signals Measurement System , 2014, Int. J. Neural Syst..

[43]  William Payre,et al.  Fully Automated Driving , 2016, Hum. Factors.

[44]  W. Boucsein,et al.  The Psychophysiology of Emotion, Arousal, and Personality: Methods and Models , 2008 .

[45]  John R. Treat,et al.  Tri-Level Study of the Causes of Traffic Accidents: An overview of final results , 1977 .

[46]  RockOn Team,et al.  Re: Attenuation compensation in single-photon emission tomography: a comparative evaluation. , 1983, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[47]  A.W.K. Gaillard,et al.  Operator Functional State: The Assessment and Prediction of Human Performance Degradation in Complex Tasks , 2003 .

[48]  Santokh Singh,et al.  Critical Reasons for Crashes Investigated in the National Motor Vehicle Crash Causation Survey , 2015 .

[49]  Rubén Usamentiaga,et al.  Driver Distraction Using Visual-Based Sensors and Algorithms , 2016, Sensors.

[50]  Neville A. Stanton,et al.  Takeover Time in Highly Automated Vehicles: Noncritical Transitions to and From Manual Control , 2017, Hum. Factors.

[51]  J C Fell,et al.  THE RELATIVE FREQUENCY OF UNSAFE DRIVING ACTS IN SERIOUS TRAFFIC CRASHES - SUMMARY TECHNICAL REPORT , 2001 .

[52]  A Priez,et al.  Bioelectric and microcirculation cutaneous sensors for the study of vigilance and emotional response during tasks and tests. , 1995, Biosensors & bioelectronics.

[53]  David M. Neyens,et al.  Assessing drivers' response during automated driver support system failures with non-driving tasks. , 2017, Journal of safety research.

[54]  Nadia W. Mullen,et al.  Physiological responses to simulated and on-road driving. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[55]  John A. Michon,et al.  A critical view of driver behavior models: What do we know , 1985 .

[56]  Shuyan Hu,et al.  Driver drowsiness detection with eyelid related parameters by Support Vector Machine , 2009, Expert Syst. Appl..

[57]  Mica R. Endsley,et al.  From Here to Autonomy , 2017, Hum. Factors.

[58]  Zhi-Hua Zhou,et al.  A literature survey on robust and efficient eye localization in real-life scenarios , 2013, Pattern Recognit..

[59]  Daniel J. Strauss,et al.  Towards the assessment of listening effort in real life situations: Mobile EEG recordings in a multimodal driving situation , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[60]  Yorgos Goletsis,et al.  Real-Time Driver's Stress Event Detection , 2012, IEEE Transactions on Intelligent Transportation Systems.

[61]  Mustapha Mouloua,et al.  DriveID: safety innovation through individuation. , 2012, Work.

[62]  Barry Strauch,et al.  The Automation-by-Expertise-by-Training Interaction , 2017, Hum. Factors.

[63]  Riender Happee,et al.  Public opinion on automated driving: results of an international questionnaire among 5000 respondents , 2015 .

[64]  Ioannis Pavlidis,et al.  A multimodal dataset for various forms of distracted driving , 2017, Scientific Data.

[65]  Carryl L. Baldwin,et al.  Validation of Essential Acoustic Parameters for Highly Urgent In-Vehicle Collision Warnings , 2018, Hum. Factors.

[66]  Mari Carmen Domingo,et al.  Integration of Body Sensor Networks and Vehicular Ad-hoc Networks for Traffic Safety , 2016, Sensors.

[67]  D. Shinar Psychology on the Road: The Human Factor in Traffic Safety , 1978 .

[68]  Charles A. Green,et al.  Human Factors Issues Associated with Limited Ability Autonomous Driving Systems: Drivers’ Allocation of Visual Attention to the Forward Roadway , 2017 .

[69]  Dietmar Otte,et al.  A New Approach of Accident Causation Analysis by Seven Steps ACASS , 2009 .

[70]  Edward M. Hitchcock,et al.  Active and passive fatigue in simulated driving: discriminating styles of workload regulation and their safety impacts. , 2013, Journal of experimental psychology. Applied.

[71]  Lisa J. Molnar,et al.  Implications of advanced vehicle technologies for older drivers. , 2017, Accident; analysis and prevention.

[72]  A. Singhal,et al.  The emotional side of cognitive distraction: Implications for road safety. , 2013, Accident; analysis and prevention.

[73]  Thomas M Granda,et al.  Roadway Human Factors and Behavioral Safety in Europe , 2005 .

[74]  Neville A. Stanton,et al.  Driving Performance After Self-Regulated Control Transitions in Highly Automated Vehicles , 2017, Hum. Factors.

[75]  Raja Parasuraman,et al.  The Role of the Air Traffic Controller in Future Air Traffic Management: An Empirical Study of Active Control versus Passive Monitoring , 2001, Hum. Factors.

[76]  B E Sabey,et al.  INTERACTING ROLES OF ROAD ENVIRONMENT VEHICLE AND ROAD USER IN ACCIDENTS , 1975 .

[77]  A. Sanders Issues and trends in the debate on discrete vs. continuous processing of information , 1990 .

[78]  Oscal T.-C. Chen,et al.  Real-time physiological and facial monitoring for safe driving , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[79]  Chin-Teng Lin,et al.  A Real-Time Wireless Brain–Computer Interface System for Drowsiness Detection , 2010, IEEE Transactions on Biomedical Circuits and Systems.

[80]  Fabio Babiloni,et al.  Evaluation of the workload and drowsiness during car driving by using high resolution EEG activity and neurophysiologic indices , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[81]  Rahul Banerjee,et al.  A comparative evaluation of neural network classifiers for stress level analysis of automotive drivers using physiological signals , 2013, Biomed. Signal Process. Control..

[82]  Stefan Haufe,et al.  Detection of braking intention in diverse situations during simulated driving based on EEG feature combination , 2015, Journal of neural engineering.

[83]  C. Collet,et al.  An integrated platform to assess driver's physiological and functional states , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[84]  Natasha Merat,et al.  Preface to the Special Section on Human Factors and Automation in Vehicles , 2012, Hum. Factors.

[85]  C. Collet,et al.  Autonomic nervous system correlates in movement observation and motor imagery , 2013, Front. Hum. Neurosci..

[86]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[87]  Muhammad Reza Pourshahabi,et al.  A Review on Driver Face Monitoring Systems for Fatigue and Distraction Detection , 2014 .

[88]  Natasha Merat,et al.  Control Task Substitution in Semiautomated Driving , 2012, Hum. Factors.