Multi-Player Dynamic Game-Based Automatic Lane-Changing Decision Model under Mixed Autonomous Vehicle and Human-Driven Vehicle Environment

The lane-changing decision-making process is challenging but critical to ensure safe and smooth maneuvers for autonomous vehicles (AVs). Conventional Gipps-type algorithms lack the flexibility for practical use under a mixed autonomous vehicle and human-driven vehicle (AV-HV) environment. Algorithms based on utility ignore the reactions of surrounding vehicles to the lane-changing vehicle. Game theory is a good way to solve the shortcomings of current algorithms, but most models based on game theory simplify the game with surrounding vehicles to the game with the following vehicle in the target lane, which means that the lane-changing decision under a mixed environment is not realized. This paper proposes a lane-changing decision-making model which is suitable for an AV to change lanes under a mixed environment based on a multi-player dynamic game theory. The overtaking expectation parameter (OEP) is introduced to estimate the utility of the following vehicle, OEP can be calculated by the proposed non-lane-based full velocity difference model with the consideration of lateral move and aggressiveness. This paper further proposes a hybrid splitting method algorithm to obtain the Nash equilibrium solution in the multi-player game to obtain the optimal strategy of lane-changing decision for AVs. An adaptive cruise control simulation environment is developed with MATLAB’s Simulink toolbox using Next Generation Simulation (NGSIM) data as the background traffic flow. The classic bicycle model is used in the control of involved HVs. Simulation results show the efficiency of the proposed multi-player dynamic game-based algorithm for lane-changing decision making by AVs under a mixed AV-HV environment.

[1]  Christos Katrakazas,et al.  Real-time motion planning methods for autonomous on-road driving: State-of-the-art and future research directions , 2015 .

[2]  Reza N. Jazar,et al.  Vehicle Dynamics: Theory and Application , 2009 .

[3]  A G Bullen,et al.  AN ELEMENTARY STOCHASTIC MODEL OF LANE-CHANGING ON A MULTILANE HIGHWAY , 1970 .

[4]  Anca D. Dragan,et al.  Planning for Autonomous Cars that Leverage Effects on Human Actions , 2016, Robotics: Science and Systems.

[5]  Joan Fisher Box,et al.  Guinness, Gosset, Fisher, and Small Samples , 1987 .

[6]  A. Schadschneider,et al.  Empirical test for cellular automaton models of traffic flow. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  Reza Langari,et al.  A Stackelberg Game Theoretic Driver Model for Merging , 2013 .

[8]  Bart De Moor,et al.  Cellular automata models of road traffic , 2005, physics/0509082.

[9]  Lily Elefteriadou,et al.  Lane‐Changing Behavior on Urban Streets: An “In‐Vehicle” Field Experiment‐Based Study , 2012, Comput. Aided Civ. Infrastructure Eng..

[10]  Pravin Varaiya,et al.  Smart cars on smart roads: problems of control , 1991, IEEE Trans. Autom. Control..

[11]  Jinya Su,et al.  Dynamic decision making in lane change: Game theory with receding horizon , 2016, 2016 UKACC 11th International Conference on Control (CONTROL).

[12]  Reza Langari,et al.  A human-like game theory-based controller for automatic lane changing , 2018 .

[13]  P. G. Gipps,et al.  A MODEL FOR THE STRUCTURE OF LANE-CHANGING DECISIONS , 1986 .

[14]  Martin Buss,et al.  Interactive scene prediction for automotive applications , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[15]  Mike McDonald,et al.  Fuzzy sets and systems for a motorway microscopic simulation model , 2000, Fuzzy Sets Syst..

[16]  Nagel.  Particle hopping models and traffic flow theory. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[17]  Ang Ji,et al.  A review of game theory models of lane changing , 2020, Transportmetrica A: Transport Science.

[18]  Weiwen Deng,et al.  An intelligent driver model with trajectory planning , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[19]  Meng Wang,et al.  Game theoretic approach for predictive lane-changing and car-following control , 2015 .

[20]  Andreas Schadschneider,et al.  Traffic flow: a statistical physics point of view , 2002 .

[21]  Jianping Wu,et al.  Development of a fuzzy logic based microscopic motorway simulation model , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[22]  Jaume Barceló,et al.  A Parallel Environment for a Real-Time Traffic Management and Information System , 1997 .

[23]  Eric van Damme,et al.  Non-Cooperative Games , 2000 .

[24]  Hesham A Rakha,et al.  A Repeated Game Freeway Lane Changing Model , 2020, Sensors.

[25]  Sebastian Thrun,et al.  ARA*: Anytime A* with Provable Bounds on Sub-Optimality , 2003, NIPS.

[26]  Moshe Ben-Akiva,et al.  MODELS OF FREEWAY LANE CHANGING AND GAP ACCEPTANCE BEHAVIOR , 1996 .

[27]  Henry X. Liu,et al.  A Game Theoretical Approach for Modelling Merging and Yielding Behavior at Freeway On-Ramp Sections , 2007 .

[28]  Benjamin Coifman,et al.  A critical evaluation of the Next Generation Simulation (NGSIM) vehicle trajectory dataset , 2017 .

[29]  Zheng Peng,et al.  An Alternating Direction Method for Nash Equilibrium of Two-Person Games with Alternating Offers , 2013, J. Optim. Theory Appl..

[30]  A. Schadschneider.  Statistical Physics of Traffic Flow , 2000, cond-mat/0007418.

[31]  Francesco Borrelli,et al.  MPC-Based Approach to Active Steering for Autonomous Vehicle Systems , 2005 .

[32]  Zuduo Zheng,et al.  Recent developments and research needs in modeling lane changing , 2014 .

[33]  Majid Sarvi,et al.  Modelling the heavy vehicle drivers’ lane changing decision under heavy traffic conditions , 2009 .

[34]  Francisco Facchinei,et al.  Decomposition algorithms for generalized potential games , 2011, Comput. Optim. Appl..

[35]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[36]  Hubert Klüpfel,et al.  Statistical Physics of Cellular Automata Models for Traffic Flow , 2002 .

[37]  Aya Hagishima,et al.  Dilemma game structure observed in traffic flow at a 2-to-1 lane junction. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[38]  Hideyuki Kita,et al.  A merging–giveway interaction model of cars in a merging section: a game theoretic analysis , 1999 .

[39]  Samer H. Hamdar.  Modeling driver behavior as a stochastic hazard-based risk-taking process , 2009 .

[40]  Panganamala Ramana Kumar,et al.  An MPC-Based Approach to Provable System-Wide Safety and Liveness of Autonomous Ground Traffic , 2014, IEEE Transactions on Automatic Control.

[41]  Andreas Lawitzky,et al.  A Game-Theoretic Approach to Replanning-Aware Interactive Scene Prediction and Planning , 2016, IEEE Transactions on Vehicular Technology.

[42]  Emilio Frazzoli,et al.  A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles , 2016, IEEE Transactions on Intelligent Vehicles.

[43]  Reza Langari,et al.  Game theory based autonomous vehicles operation , 2014 .

[44]  Sheng Jin,et al.  Non-lane-based full velocity difference car following model , 2010 .

[45]  Alex Pentland,et al.  Modeling and Prediction of Human Behavior , 1999, Neural Computation.

[46]  Zuduo Zheng,et al.  A game theory-based approach for modelling mandatory lane-changing behaviour in a connected environment , 2019, Transportation Research Part C: Emerging Technologies.

[47]  A. Schadschneider,et al.  Statistical physics of vehicular traffic and some related systems , 2000, cond-mat/0007053.

[48]  Reza Langari,et al.  Stackelberg Game Based Model of Highway Driving , 2012 .

[49]  Jonas Sjöberg,et al.  Strategic decision making for automated driving on two-lane, one way roads using model predictive control , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[50]  Nakayama,et al.  Dynamical model of traffic congestion and numerical simulation. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[51]  Jianping Wu,et al.  Lane changing on the motorway: factors affecting its occurrence, and their implications , 1998 .

[52]  Harilaos N. Koutsopoulos,et al.  A microscopic traffic simulator for evaluation of dynamic traffic management systems , 1996 .

[53]  Hani S. Mahmassani,et al.  Modeling Lane-Changing Behavior in a Connected Environment: A Game Theory Approach , 2015 .

[54]  Jaume Barceló,et al.  Modelling Advanced Transport Telematic Applications with Microscopic Simulators: The Case of AIMSUN2 , 1999 .

[55]  Sanjoy Das,et al.  Microscopic simulations of freeway traffic flow , 1999, Proceedings 32nd Annual Simulation Symposium.