Towards a cognitive warning system for safer hybrid traffic

. Technological development brings increasingly closer the era of widely available self-driving cars. However, presumably there will be a time when human drivers and self-driving cars would share the same roads. In the current paper, we propose a cognitive warning system that utilizes information collected from the behaviour of the human driver and sends warning signals to self-driving cars in case of human related emergency. We demonstrate that such risk detection can identify danger earlier than an external sensor would, based on the behaviour of the human-driven vehicle. We used data from a simulator experiment, where 21 participants slalomed between road bumps in a virtual reality environment. Occasionally, they had to react to dangerous roadside stimuli by large steering movements. We used one-class SVM to detect emergency behaviour in both steering and vehicle trajectory data. We found earlier detection of emergency based on steering wheel data, than based on vehicle trajectory data. We conclude that tracking cognitive variables of the human driver means that we can utilize the outstanding power of the brain to evaluate external stimuli. Information about the result of this evaluation (be it steering action or saccade) could be the basis of a warning signal that is readily understood by the computer of a self-driving car.

[1]  Cristy Ho,et al.  Looming Auditory and Vibrotactile Collision Warning for Safe Driving , 2017 .

[2]  Ch. Ramesh Babu,et al.  Internet of Vehicles: From Intelligent Grid to Autonomous Cars and Vehicular Clouds , 2016 .

[3]  Christopher Leckie,et al.  High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning , 2016, Pattern Recognit..

[4]  Chun-Hsiang Chuang,et al.  An EEG-Based Fatigue Detection and Mitigation System , 2016, Int. J. Neural Syst..

[5]  Tammy E. Trimble,et al.  Automated Vehicle Crash Rate Comparison Using Naturalistic Data , 2016 .

[6]  Wendy Ju,et al.  Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance , 2014, International Journal on Interactive Design and Manufacturing (IJIDeM).

[7]  Daniel Miletics Human decisions at irregular overtakings , 2015, 2015 6th IEEE International Conference on Cognitive Infocommunications (CogInfoCom).

[8]  Wei Yuan,et al.  Multi-parameter prediction of drivers' lane-changing behaviour with neural network model. , 2015, Applied ergonomics.

[9]  Wendy Ju,et al.  Timing of unstructured transitions of control in automated driving , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[10]  Domitilla Del Vecchio,et al.  Stochastic hybrid models for predicting the behavior of drivers facing the yellow-light-dilemma , 2015, 2015 American Control Conference (ACC).

[11]  Tao Lu,et al.  The traffic accident hotspot prediction: Based on the logistic regression method , 2015, 2015 International Conference on Transportation Information and Safety (ICTIS).

[12]  Sophie Lambert-Lacroix,et al.  Real-Time Fault Detection in Semiconductor Using One-Class Support Vector Machines , 2015 .

[13]  Tianwei Shi,et al.  Real-Time EEG-Based Detection of Fatigue Driving Danger for Accident Prediction , 2015, Int. J. Neural Syst..

[14]  M. Mitchell Waldrop,et al.  Autonomous vehicles: No drivers required , 2015, Nature.

[15]  Timo Sukuvaara,et al.  Vehicle in a cognitive network , 2015, Intell. Decis. Technol..

[16]  Soyoung Ahn,et al.  On the periodicity of traffic oscillations and capacity drop : the role of driver characteristics , 2014 .

[17]  Joni Jamsa Cognitive communication for traffic safety , 2014, 2014 5th IEEE Conference on Cognitive Infocommunications (CogInfoCom).

[18]  Marja Matinmikko,et al.  Active antenna system for cognitive network enhancement , 2014, 2014 5th IEEE Conference on Cognitive Infocommunications (CogInfoCom).

[19]  Ilsoo Yun,et al.  A Comparative Study On Accident Prediction Model Using Nonlinear Regression And Artificial Neural Network, Structural Equation for Rural 4-Legged Intersection , 2014 .

[20]  Hans Colonius,et al.  Designing Driver Assistance Systems with Crossmodal Signals: Multisensory Integration Rules for Saccadic Reaction Times Apply , 2014, PloS one.

[21]  Frank E. Pollick,et al.  Evaluating multimodal driver displays under varying situational urgency , 2014, CHI.

[22]  Mario Gerla,et al.  Internet of vehicles: From intelligent grid to autonomous cars and vehicular clouds , 2014, 2014 IEEE World Forum on Internet of Things (WF-IoT).

[23]  Donna Lloyd,et al.  In Touch with the Future: The Sense of Touch from Cognitive Neuroscience to Virtual Reality , 2014, PRESENCE: Teleoperators and Virtual Environments.

[24]  A. Torok,et al.  Integration of warning signals and signaled objects to a multimodal object: A pilot study , 2013, 2013 IEEE 4th International Conference on Cognitive Infocommunications (CogInfoCom).

[25]  Nathan Srebro,et al.  Learning Optimally Sparse Support Vector Machines , 2013, ICML.

[26]  Attila Borsos,et al.  Is Smeed’s law still valid? A world-wide analysis of the trends in fatality rates , 2013 .

[27]  Javier Gozalvez,et al.  Cooperative vehicle-to-vehicle active safety testing under challenging conditions , 2013 .

[28]  Christian Berger,et al.  Autonomous Driving-5 Years after the Urban Challenge: The Anticipatory Vehicle as a Cyber-Physical System , 2014, GI-Jahrestagung.

[29]  Li Liu,et al.  Dynamic Modeling of Driver Control Strategy of Lane-Change Behavior and Trajectory Planning for Collision Prediction , 2012, IEEE Transactions on Intelligent Transportation Systems.

[30]  P. Baranyi,et al.  Definition and synergies of cognitive infocommunications , 2012 .

[31]  Misha Pavel,et al.  A framework for rapid visual image search using single-trial brain evoked responses , 2011, Neurocomputing.

[32]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[33]  Jari Saramäki,et al.  Small But Slow World: How Network Topology and Burstiness Slow Down Spreading , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  Wes McKinney,et al.  pandas: a Foundational Python Library for Data Analysis and Statistics , 2011 .

[35]  Hans Colonius,et al.  The Multisensory Driver: Contributions from the Time-Window-of-Integration Model , 2011 .

[36]  Peter Baranyi,et al.  Cognitive infocommunications: CogInfoCom , 2010, 2010 11th International Symposium on Computational Intelligence and Informatics (CINTI).

[37]  Masato Abe,et al.  Vehicle Handling Dynamics: Theory and Application , 2009 .

[38]  Albert-László Barabási,et al.  Understanding the Spreading Patterns of Mobile Phone Viruses , 2009, Science.

[39]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[40]  Cristy Ho,et al.  Multisensory In-Car Warning Signals for Collision Avoidance , 2007, Hum. Factors.

[41]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[42]  Guido van Rossum,et al.  Python Programming Language , 2007, USENIX Annual Technical Conference.

[43]  Wolfgang Birk,et al.  Evaluation of Lane Departure Warnings for Drowsy Drivers , 2006 .

[44]  Johan Engström,et al.  Effects of visual and cognitive load in real and simulated motorway driving , 2005 .

[45]  Ryszard Andrzejewski,et al.  Nonlinear dynamics of a wheeled vehicle , 2005 .

[46]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[47]  Tieniu Tan,et al.  Traffic accident prediction using 3-D model-based vehicle tracking , 2004, IEEE Transactions on Vehicular Technology.

[48]  Srdjan Capkun,et al.  The security and privacy of smart vehicles , 2004, IEEE Security & Privacy Magazine.

[49]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[50]  Y. Moses,et al.  Real time facial expression recognition in video using support vector machines , 2003, ICMI '03.

[51]  Tieniu Tan,et al.  Traffic accident prediction using vehicle tracking and trajectory analysis , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[52]  Poul Greibe,et al.  Accident prediction models for urban roads. , 2003, Accident; analysis and prevention.

[53]  Håkan Jansson,et al.  An analysis of driver’s steering behaviour during auditory or haptic warnings for the designing of lane departure warning system , 2003 .

[54]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[55]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[56]  Ahmed E. Radwan,et al.  Modeling traffic accident occurrence and involvement. , 2000, Accident; analysis and prevention.

[57]  Bernhard Schölkopf,et al.  Support Vector Method for Novelty Detection , 1999, NIPS.

[58]  Marti A. Hearst Trends & Controversies: Support Vector Machines , 1998, IEEE Intell. Syst..

[59]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[60]  L Mountain,et al.  Accident prediction models for roads with minor junctions. , 1996, Accident; analysis and prevention.

[61]  Hiroshi Ueno,et al.  Development of drowsiness detection system , 1994, Proceedings of VNIS'94 - 1994 Vehicle Navigation and Information Systems Conference.

[62]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[63]  M. Aizerman,et al.  Theoretical Foundations of the Potential Function Method in Pattern Recognition Learning , 1964 .