A VR Truck Docking Simulator Platform for Developing Personalized Driver Assistance

Professional truck drivers frequently face the challenging task of manually backwards manoeuvring articulated vehicles towards the loading bay. Logistics companies experience costs due to damage caused by vehicles performing this manoeuvre. However, driver assistance aimed to support drivers in this special scenario has not yet been clearly established. Additionally, to optimally improve the driving experience and the performance of the assisted drivers, the driver assistance must be able to continuously adapt to the needs and preferences of each driver. This paper presents the VISTA-Sim, a platform that uses a virtual reality (VR) simulator to develop and evaluate personalized driver assistance. This paper provides a comprehensive account of the VISTA-Sim, describing its development and main functionalities. The paper reports the usage of VISTA-Sim through the scenario of parking a semi-trailer truck in a loading bay, demonstrating how to learn from driver behaviours. Promising preliminary results indicate that this platform provides means to automatically learn from a driver’s performance. The evolution of this platform can offer ideal conditions for the development of ADAS systems that can automatically and continuously learn from and adapt to an individual driver. Therefore, future ADAS systems can be better accepted and trusted by drivers. Finally, this paper discusses the future directions concerning the improvement of the platform.

[1]  Razvan Pascanu,et al.  Overcoming catastrophic forgetting in neural networks , 2016, Proceedings of the National Academy of Sciences.

[2]  Junqiang Xi,et al.  Modeling and Recognizing Driver Behavior Based on Driving Data: A Survey , 2014 .

[3]  Julie A. Shah,et al.  A Situation Awareness-Based Framework for Design and Evaluation of Explainable AI , 2020, EXTRAAMAS@AAMAS.

[4]  Moritz Körber,et al.  Introduction matters: Manipulating trust in automation and reliance in automated driving. , 2018, Applied ergonomics.

[5]  Haobin Jiang,et al.  Implementation of Human-Like Driver Model Based on Recurrent Neural Networks , 2019, IEEE Access.

[6]  S. H. Choi,et al.  A versatile virtual prototyping system for rapid product development , 2008, Comput. Ind..

[7]  Frans Tillema,et al.  INTRALOG – intelligent autonomous truck applications in logistics; single and double articulated autonomous rearward docking on DCs , 2018 .

[8]  Glyn Lawson,et al.  Future directions for the development of virtual reality within an automotive manufacturer. , 2016, Applied ergonomics.

[9]  Ranjana K. Mehta,et al.  Evaluating advanced driver-assistance system trainings using driver performance, attention allocation, and neural efficiency measures. , 2020, Applied ergonomics.

[10]  Frederik Diederichs,et al.  Guerilla Evaluation of Truck HMI with VR , 2020, HCI.

[11]  Heiko Wersing,et al.  A Survey of Personalization for Advanced Driver Assistance Systems , 2020, IEEE Transactions on Intelligent Vehicles.

[12]  Minoru Sasaki,et al.  Virtual Reality Driving Simulation for Measuring Driver Behavior and Characteristics , 2017 .

[13]  Masayoshi Tomizuka,et al.  An Overview on Study of Identification of Driver Behavior Characteristics for Automotive Control , 2014 .

[14]  Stefan Wermter,et al.  Continual Lifelong Learning with Neural Networks: A Review , 2019, Neural Networks.

[15]  Alexis Paljic,et al.  Get ready for automated driving using Virtual Reality. , 2018, Accident; analysis and prevention.

[16]  Michael Weber,et al.  Virtual Reality Driving Simulator Based on Head-Mounted Displays , 2017 .

[17]  Carlos Duarte,et al.  The Contribution of Multimodal Adaptation Techniques to the GUIDE Interface , 2011, HCI.

[18]  Etienne Perot,et al.  Deep Reinforcement Learning framework for Autonomous Driving , 2017, Autonomous Vehicles and Machines.

[19]  Jianfeng Hu,et al.  Real-time eye tracking for the assessment of driver fatigue , 2018, Healthcare technology letters.

[20]  Gary E. Riccio,et al.  Visually Induced Motion Sickness in Virtual Environments , 1992, Presence: Teleoperators & Virtual Environments.

[21]  David W. Aha,et al.  DARPA's Explainable Artificial Intelligence (XAI) Program , 2019, AI Mag..