Neural Network based Interactive Lane Changing Planner in Dense Traffic with Safety Guarantee

Neural network based planners have shown great promises in improving performance and task success rate in autonomous driving. However, it is very challenging to ensure safety of the system with learning enabled components, especially in dense and highly interactive traffic environments. In this work, we propose a neural network based lane changing planner framework that can ensure safety while sustaining system efficiency. To prevent too conservative planning, we assess the aggressiveness and identify the driving behavior of surrounding vehicles, then adapt the planned trajectory for the ego vehicle accordingly. The ego vehicle can proceed to change lanes if a safe evasion trajectory exists even in the worst case, otherwise, it can hesitate around current lateral position or return back to the original lane. We also quantitatively demonstrate the effectiveness of our planner design and its advantage over other baselines through extensive simulations with diverse and comprehensive experimental settings.

[1]  Amnon Shashua,et al.  On a Formal Model of Safe and Scalable Self-driving Cars , 2017, ArXiv.

[2]  Christoph Stiller,et al.  Provably Safe and Smooth Lane Changes in Mixed Trafic , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[3]  Bin Ran,et al.  A dynamic lane-changing trajectory planning model for automated vehicles , 2018, Transportation Research Part C: Emerging Technologies.

[4]  Dhruv Saxena,et al.  Cooperation-Aware Lane Change Maneuver in Dense Traffic based on Model Predictive Control with Recurrent Neural Network , 2019, 2020 American Control Conference (ACC).

[5]  David González,et al.  A Review of Motion Planning Techniques for Automated Vehicles , 2016, IEEE Transactions on Intelligent Transportation Systems.

[6]  Mingxi Cheng,et al.  A General Trust Framework for Multi-Agent Systems , 2021, AAMAS.

[7]  David Isele,et al.  Interactive Decision Making for Autonomous Vehicles in Dense Traffic , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[8]  Mykel J. Kochenderfer,et al.  Cooperation-Aware Reinforcement Learning for Merging in Dense Traffic , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[9]  Zuduo Zheng,et al.  Recent developments and research needs in modeling lane changing , 2014 .

[10]  Nikolce Murgovski,et al.  Safe autonomous lane changes in dense traffic , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[11]  Shengbo Eben Li,et al.  Model-based Constrained Reinforcement Learning using Generalized Control Barrier Function , 2021, 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  John M. Dolan,et al.  Trajectory Planning for Autonomous Vehicles Using Hierarchical Reinforcement Learning , 2020, 2021 IEEE International Intelligent Transportation Systems Conference (ITSC).

[13]  Yue Wang,et al.  Learning hierarchical behavior and motion planning for autonomous driving , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  John M. Dolan,et al.  Attention-based Hierarchical Deep Reinforcement Learning for Lane Change Behaviors in Autonomous Driving , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Dorsa Sadigh,et al.  Reinforcement Learning based Control of Imitative Policies for Near-Accident Driving , 2020, Robotics: Science and Systems.

[16]  Insup Lee,et al.  Verisig: verifying safety properties of hybrid systems with neural network controllers , 2018, HSCC.

[17]  Elmira Amirloo Abolfathi,et al.  Towards Practical Hierarchical Reinforcement Learning for Multi-lane Autonomous Driving , 2018 .

[18]  Xenofon D. Koutsoukos,et al.  Safety Verification of Cyber-Physical Systems with Reinforcement Learning Control , 2019, ACM Trans. Embed. Comput. Syst..

[19]  Hani S. Mahmassani,et al.  Modeling Lane-Changing Behavior in a Connected Environment: A Game Theory Approach , 2015 .

[20]  Pin Wang,et al.  Automated Lane Change Strategy using Proximal Policy Optimization-based Deep Reinforcement Learning , 2020, 2020 IEEE Intelligent Vehicles Symposium (IV).

[21]  Jiameng Fan,et al.  ReachNN , 2019, ACM Trans. Embed. Comput. Syst..

[22]  Kun Cao,et al.  A dynamic automated lane change maneuver based on vehicle-to-vehicle communication , 2016 .

[23]  Masayoshi Tomizuka,et al.  Interaction-Aware Behavior Planning for Autonomous Vehicles Validated with Real Traffic Data , 2020, ArXiv.

[24]  Matthias Althoff,et al.  Verifying the safety of lane change maneuvers of self-driving vehicles based on formalized traffic rules , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[25]  Qi Zhu,et al.  Trajectory Planning for Connected and Automated Vehicles: Cruising, Lane Changing, and Platooning , 2020, SAE International Journal of Connected and Automated Vehicles.

[26]  Ching-Yao Chan,et al.  Driving Decision and Control for Automated Lane Change Behavior based on Deep Reinforcement Learning , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[27]  Nazim Kemal Ure,et al.  Automated Lane Change Decision Making using Deep Reinforcement Learning in Dynamic and Uncertain Highway Environment , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[28]  Wei Zhan,et al.  A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learning , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Martin Lauer,et al.  Interaction aware cooperative trajectory planning for lane change maneuvers in dense traffic , 2020, 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC).

[30]  Mohan M. Trivedi,et al.  Dynamic Probabilistic Drivability Maps for Lane Change and Merge Driver Assistance , 2014, IEEE Transactions on Intelligent Transportation Systems.

[31]  Gábor Orosz,et al.  Optimal Control of Connected Vehicle Systems With Communication Delay and Driver Reaction Time , 2017, IEEE Transactions on Intelligent Transportation Systems.

[32]  Mortuza Ali,et al.  An efficient cooperative lane-changing algorithm for sensor- and communication-enabled automated vehicles , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).