Adaptive Visual Assistance System for Enhancing the Driver Awareness of Pedestrians

ABSTRACT In the past decade, Pedestrian Collision Warning Systems have been proposed to detect pedestrians and warn drivers of imminent collision. However, such systems are often limited by eye-off-road and cognitive overload problems. Head Up displays with augmented reality are being considered as a key technology for changing drivers’ user experiences. In this paper, we propose a new visual assistance system that can enhance drivers’ perception by dynamically directing attention to pedestrians to avoid collisions using Augmented Reality cues. The proposed system takes into account driver behaviors through vehicle driving signals analysis, in order to warn it at the right moments. To that end, we statistically model correct and incorrect driver behaviors in situations with pedestrians. Based on this model, a warning visual metaphor is displayed if unawareness is detected and a driving simulator was used to evaluate the concept. The experimental results suggest that our proposed adaptive visual aids can enhance driver awareness of pedestrians in critical situations.

[1]  Sahar Ghanipoor Machiani,et al.  Drivers’ Performance Examination using a Personalized Adaptive Curve Speed Warning: Driving Simulator Study , 2019, Int. J. Hum. Comput. Interact..

[2]  F. Rivara,et al.  Strengthening the prevention and care of injuries worldwide , 2004, The Lancet.

[3]  John D. Lee,et al.  Augmented Reality Cues and Elderly Driver Hazard Perception , 2013, Hum. Factors.

[4]  Véronique Berge-Cherfaoui,et al.  Estimation of driver awareness of pedestrian based on Hidden Markov Model , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[5]  Dinesh Mohan WORK TRIPS AND SAFETY OF BICYCLISTS , 2002 .

[6]  Jonathan P. How,et al.  Driver Behavior Classification at Intersections and Validation on Large Naturalistic Data Set , 2012, IEEE Transactions on Intelligent Transportation Systems.

[7]  K. Sundaraj,et al.  Driver inattention detection methods: A review , 2012, 2012 IEEE Conference on Sustainable Utilization and Development in Engineering and Technology (STUDENT).

[8]  Avinash Wesley,et al.  A novel method to monitor driver's distractions , 2010, CHI EA '10.

[9]  Necmettin Sezgin,et al.  Estimating vigilance level by using EEG and EMG signals , 2008, Neural Computing and Applications.

[10]  Elena Lopez,et al.  Visual Monitoring of Driver Inattention , 2008 .

[11]  A. Fascioli,et al.  Pedestrian Protection Systems : Issues , Survey , and Challenges , 2007 .

[12]  Christopher D. Wickens,et al.  Display Signaling in Augmented Reality: Effects of Cue Reliability and Image Realism on Attention Allocation and Trust Calibration , 2001, Hum. Factors.

[13]  Linda G. Pierce,et al.  The Perceived Utility of Human and Automated Aids in a Visual Detection Task , 2002, Hum. Factors.

[14]  C. Metz Basic principles of ROC analysis. , 1978, Seminars in nuclear medicine.

[15]  Karel Brookhuis,et al.  HMI and Safety-Related Driver Performance , 2004 .

[16]  John R. Wagner,et al.  Analysis of in-vehicle driver behaviour data for improved safety , 2011 .

[17]  L. Wood,et al.  From the Authors , 2003, European Respiratory Journal.

[18]  Danil Prokhorov,et al.  Computational Intelligence in Automotive Applications , 2008, Computational Intelligence in Automotive Applications.

[19]  John D Lee,et al.  Directing driver attention with augmented reality cues. , 2013, Transportation research. Part F, Traffic psychology and behaviour.

[20]  Véronique Berge-Cherfaoui,et al.  Recognizing Driver Awareness of Pedestrian , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[21]  O. Mano,et al.  Forward collision warning with a single camera , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[22]  Jeff A. Bilmes,et al.  A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models , 1998 .

[23]  Hiroshi Ueno,et al.  Development of drowsiness detection system , 1994, Proceedings of VNIS'94 - 1994 Vehicle Navigation and Information Systems Conference.

[24]  Mohan M. Trivedi,et al.  Gaze fixations and dynamics for behavior modeling and prediction of on-road driving maneuvers , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[25]  D L Fisher,et al.  Visual Displays: The Highlighting Paradox , 1989, Human factors.

[26]  Jonathan M Hankey,et al.  A method for evaluating collision avoidance systems using naturalistic driving data. , 2008, Accident; analysis and prevention.

[27]  J. Jonides Voluntary versus automatic control over the mind's eye's movement , 1981 .

[28]  Tamitza Toroyan,et al.  Global status report on road safety , 2009, Injury Prevention.

[29]  M. Trivedi,et al.  Head and eye gaze dynamics during visual attention shifts in complex environments. , 2012, Journal of vision.

[30]  Joseph L. Gabbard,et al.  Behind the Glass: Driver Challenges and Opportunities for AR Automotive Applications , 2014, Proceedings of the IEEE.

[31]  Lewis M. Mackenzie,et al.  Evaluation of Collision Avoidance Prototype Head-Up Display Interface for Older Drivers , 2011, HCI.

[32]  Keiichi Yamada,et al.  Estimating driver awareness of pedestrians from driving behavior based on a probabilistic model , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[33]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[34]  Anind K. Dey,et al.  Simulated augmented reality windshield display as a cognitive mapping aid for elder driver navigation , 2009, CHI.

[35]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[36]  Heiner Bubb,et al.  Situation awareness assessment in critical driving situations at intersections by task and human error analysis , 2009 .

[37]  Claudia J. Stanny,et al.  Effects of distraction and experience on situation awareness and simulated driving , 2007 .

[38]  Zhong Zhang,et al.  Driving behavior classification river sensing based on vehicle steering wheel operations , 2008, 2008 SICE Annual Conference.

[39]  Ying Ying Tan,et al.  PERCLOS Threshold for Drowsiness Detection during Real Driving , 2012 .