Driver Behavior Modeling Using Game Engine and Real Vehicle: A Learning-Based Approach

As a good example of Advanced Driver-Assistance Systems (ADAS), Advisory Speed Assistance (ASA) helps improve driving safety and possibly energy efficiency by showing advisory speed to the driver of an intelligent vehicle. However, driver-based speed tracking errors often emerge, due to the perception and reaction delay, as well as imperfect vehicle control, degrading the effectiveness of ASA system. In this study, we propose a learning-based approach to modeling driver behavior, aiming to predict and compensate for the speed tracking errors in real time. Subject drivers are first classified into different types according to their driving behaviors using the k-nearest neighbors (k-NN) algorithm. A nonlinear autoregressive (NAR) neural network is then adopted to predict the speed tracking errors generated by each driver. A specific traffic scenario has been created in a Unity game engine-based driving simulator platform, where ASA system provides advisory driving speed to the driver via a head-up display (HUD). A human-in-the-loop simulation study is conducted by 17 volunteer drivers, revealing a 53% reduction in the speed error variance and a 3% reduction in the energy consumption with the compensation of the speed tracking errors. The results are further validated by a field implementation with a real passenger vehicle.

[1]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[2]  Guoyuan Wu,et al.  Cooperative Ramp Merging System: Agent-Based Modeling and Simulation Using Game Engine , 2019, SAE International Journal of Connected and Automated Vehicles.

[3]  I.J. Perez-Arriaga,et al.  Unity for all , 2009, IEEE Power and Energy Magazine.

[4]  Sandeep Neema,et al.  ADAS Virtual Prototyping using Modelica and Unity Co-simulation via OpenMETA , 2016 .

[5]  Azim Eskandarian,et al.  Research advances in intelligent collision avoidance and adaptive cruise control , 2003, IEEE Trans. Intell. Transp. Syst..

[6]  Junmin Wang,et al.  A Driver Steering Model With Personalized Desired Path Generation , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[7]  Keqiang Li,et al.  Distributed conflict-free cooperation for multiple connected vehicles at unsignalized intersections , 2018, Transportation Research Part C: Emerging Technologies.

[8]  Hong Jiang,et al.  Establishing Style-Oriented Driver Models by Imitating Human Driving Behaviors , 2015, IEEE Transactions on Intelligent Transportation Systems.

[9]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[10]  Andrea Goldsmith,et al.  Effects of communication delay on string stability in vehicle platoons , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[11]  Zhensong Wei,et al.  Vision-Based Lane-Changing Behavior Detection Using Deep Residual Neural Network , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[12]  Junqiang Xi,et al.  Learning and Inferring a Driver's Braking Action in Car-Following Scenarios , 2018, IEEE Transactions on Vehicular Technology.

[13]  Mohan M. Trivedi,et al.  Driver Behavior and Situation Aware Brake Assistance for Intelligent Vehicles , 2007, Proceedings of the IEEE.

[14]  Shinichi Shiraishi,et al.  Testing Autonomous Vehicle Software in the Virtual Prototyping Environment , 2017, IEEE Embedded Systems Letters.

[15]  Francesco Borrelli,et al.  A Learning-Based Framework for Velocity Control in Autonomous Driving , 2016, IEEE Transactions on Automation Science and Engineering.

[16]  Yi Lu Murphey,et al.  Driver's style classification using jerk analysis , 2009, 2009 IEEE Workshop on Computational Intelligence in Vehicles and Vehicular Systems.

[17]  Monica Vladoiu,et al.  Driving Style Analysis Using Data Mining Techniques , 2010, Int. J. Comput. Commun. Control.

[18]  David Gerónimo Gómez,et al.  Survey of Pedestrian Detection for Advanced Driver Assistance Systems , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Hesham A. Rakha,et al.  Freeway Speed Harmonization , 2016, IEEE Transactions on Intelligent Vehicles.

[20]  N. van Nes,et al.  Improving speed behaviour: the potential of in-car speed assistance and speed limit credibility , 2008 .

[21]  A. Augustynowicz Preliminary classification of driving style with objective rank method , 2009 .

[22]  Petros A. Ioannou,et al.  Personalized Driver/Vehicle Lane Change Models for ADAS , 2015, IEEE Transactions on Vehicular Technology.

[23]  Guoyuan Wu,et al.  Distributed Consensus-Based Cooperative Highway On-Ramp Merging Using V2X Communications , 2018 .

[24]  Kazuya Takeda,et al.  Driver Modeling Based on Driving Behavior and Its Evaluation in Driver Identification , 2007, Proceedings of the IEEE.

[25]  A. Lapedes,et al.  Nonlinear signal processing using neural networks: Prediction and system modelling , 1987 .

[26]  Petros A. Ioannou,et al.  Personalized Driver Assistance for Signalized Intersections Using V2I Communication , 2016, IEEE Transactions on Intelligent Transportation Systems.

[27]  Guoyuan Wu,et al.  Connected Cooperative Ecodriving System Considering Human Driver Error , 2018, IEEE Transactions on Intelligent Transportation Systems.

[28]  M. Barth,et al.  Connected Eco-Approach and Departure (EAD) System for Diesel Trucks , 2018 .

[29]  A. Reig,et al.  Modelling driving behaviour and its impact on the energy management problem in hybrid electric vehicles , 2014, Int. J. Comput. Math..

[30]  Guoyuan Wu,et al.  Lookup Table-Based Consensus Algorithm for Real-Time Longitudinal Motion Control of Connected and Automated Vehicles , 2019, 2019 American Control Conference (ACC).

[31]  Peng Hao,et al.  Early Findings from Field Trials of Heavy-Duty Truck Connected Eco-Driving System , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[32]  Bo Gao,et al.  Driving Style Recognition for Intelligent Vehicle Control and Advanced Driver Assistance: A Survey , 2018, IEEE Transactions on Intelligent Transportation Systems.

[33]  Alicia L. Carriquiry,et al.  Driving behavior at a roundabout: A hierarchical Bayesian regression analysis , 2014 .

[34]  Karel Brookhuis,et al.  Opportunities of advanced driver assistance systems towards overtaking , 2005 .

[35]  Germán Ros,et al.  CARLA: An Open Urban Driving Simulator , 2017, CoRL.

[36]  梁奉源 Head-up display for automobile , 1994 .

[37]  Junqiang Xi,et al.  A Learning-Based Approach for Lane Departure Warning Systems With a Personalized Driver Model , 2017, IEEE Transactions on Vehicular Technology.

[38]  Mike McDonald,et al.  Advanced Driver Assistance Systems from Autonomous to Cooperative Approach , 2008 .