Multi-Modal Interaction-Aware Motion Prediction at Unsignalized Intersections

Autonomous vehicle technologies have evolved quickly over the last few years, with safety being one of the key requirements for their full deployment. However, ensuring their safety while navigating through highly interactive and complex scenarios remains a critical challenge. To tackle this problem, intention estimation and motion prediction are fundamental. In this work, a method to infer the intentions, based on a Dynamic Bayesian Network (DBN), and predict the motion, using Markov Chains, of the nearby vehicles at unsignalized intersections is proposed. This approach considers all possible corridors of the surrounding traffic participants and takes into account their interactions to infer the probabilities of stopping or crossing the intersection, as well as the probability of being in each of the possible navigable corridors. To achieve this, the DBN is used to model the relationships between the observed states and the unobserved intentions of the nearby agents. The Markov Chain model, obtained from a kinematic model, is used to predict the future motions of the vehicles, taking into account their current state, their inferred intentions, and the uncertainty associated with the prediction. The resulting multi-modal motion predictions are sent to the ego vehicle to navigate through the scene. The proposed method is evaluated in 6 real situations extracted from publicly available datasets and is compared with a model-based and a learn-based baseline models. The results showed that the proposed method outperformed both baselines in terms of accuracy considering the metrics ADE and FDE.

[1]  Juan Felipe Medina-Lee,et al.  Speed Profile Generation Strategy for Efficient Merging of Automated Vehicles on Roundabouts With Realistic Traffic , 2023, IEEE Transactions on Intelligent Vehicles.

[2]  Djamel Eddine Benrachou,et al.  Use of Social Interaction and Intention to Improve Motion Prediction Within Automated Vehicle Framework: A Review , 2022, IEEE Transactions on Intelligent Transportation Systems.

[3]  Chen Lv,et al.  Multi-Agent Trajectory Prediction With Heterogeneous Edge-Enhanced Graph Attention Network , 2022, IEEE Transactions on Intelligent Transportation Systems.

[4]  B. Williams,et al.  M2I: From Factored Marginal Trajectory Prediction to Interactive Prediction , 2022, Computer Vision and Pattern Recognition.

[5]  Fabien Moutarde,et al.  THOMAS: Trajectory Heatmap Output with learned Multi-Agent Sampling , 2021, ICLR.

[6]  Chen Lv,et al.  Multi-modal Motion Prediction with Transformer-based Neural Network for Autonomous Driving , 2021, 2022 International Conference on Robotics and Automation (ICRA).

[7]  Hang Zhao,et al.  DenseTNT: End-to-end Trajectory Prediction from Dense Goal Sets , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[8]  Bolei Zhou,et al.  Multimodal Motion Prediction with Stacked Transformers , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Ron Schindler,et al.  An analysis of European crash data and scenario specification for heavy truck safety system development within the AEROFLEX project , 2021, 2103.05325.

[10]  Jorge Godoy,et al.  A Grid-Based Framework for Collective Perception in Autonomous Vehicles , 2021, Sensors.

[11]  Elena Torta,et al.  Particle Filters: A Hands-On Tutorial , 2021, Sensors.

[12]  Juan Felipe Medina Lee,et al.  Reachability Estimation in Dynamic Driving Scenes for Autonomous Vehicles , 2020, 2020 IEEE Intelligent Vehicles Symposium (IV).

[13]  Alberto Del Bimbo,et al.  Multiple Future Prediction Leveraging Synthetic Trajectories , 2020, 2020 25th International Conference on Pattern Recognition (ICPR).

[14]  Dragomir Anguelov,et al.  VectorNet: Encoding HD Maps and Agent Dynamics From Vectorized Representation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Yonghwan Jeong,et al.  Target Vehicle Motion Prediction-Based Motion Planning Framework for Autonomous Driving in Uncontrolled Intersections , 2019, IEEE Transactions on Intelligent Transportation Systems.

[16]  Lutz Eckstein,et al.  The inD Dataset: A Drone Dataset of Naturalistic Road User Trajectories at German Intersections , 2019, 2020 IEEE Intelligent Vehicles Symposium (IV).

[17]  Benjamin Sapp,et al.  MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Prediction , 2019, CoRL.

[18]  Masayoshi Tomizuka,et al.  INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Maps , 2019, ArXiv.

[19]  M. Chuah,et al.  GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Driving , 2019 .

[20]  Wei Zhan,et al.  Multi-modal Probabilistic Prediction of Interactive Behavior via an Interpretable Model , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[21]  Marimuthu Palaniswami,et al.  A Scalable Framework for Trajectory Prediction , 2018, IEEE Transactions on Intelligent Transportation Systems.

[22]  Darius Burschka,et al.  Interaction-Aware Probabilistic Behavior Prediction in Urban Environments , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Matthias Althoff,et al.  Interaction-aware occupancy prediction of road vehicles , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[24]  Matthias Althoff,et al.  Set-Based Prediction of Traffic Participants on Arbitrary Road Networks , 2016, IEEE Transactions on Intelligent Vehicles.

[25]  Malte Risto,et al.  The social behavior of autonomous vehicles , 2016, UbiComp Adjunct.

[26]  Christian Laugier,et al.  Intention-aware risk estimation: Field results , 2015, 2015 IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO).

[27]  Dizan Vasquez,et al.  A survey on motion prediction and risk assessment for intelligent vehicles , 2014, ROBOMECH Journal.

[28]  Julius Ziegler,et al.  Lanelets: Efficient map representation for autonomous driving , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[29]  Christian Laugier,et al.  Intention-Aware Risk Estimation for General Traffic Situations, and Application to Intersection Safety , 2013 .

[30]  Carlos Canudas-de-Wit,et al.  A Safe Longitudinal Control for Adaptive Cruise Control and Stop-and-Go Scenarios , 2007, IEEE Transactions on Control Systems Technology.

[31]  Peter A. Wieringa,et al.  Intersection approach speed and accident probability , 2006 .

[32]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[33]  Shlomo Zilberstein,et al.  Using Anytime Algorithms in Intelligent Systems , 1996, AI Mag..

[34]  J. Villagra,et al.  Interaction-Aware Intention Estimation at Roundabouts , 2021, IEEE Access.

[35]  Yonghwan Jeong,et al.  Self-Adaptive Motion Prediction-Based Proactive Motion Planning for Autonomous Driving in Urban Environments , 2021, IEEE Access.

[36]  Junxiang Li,et al.  A Dynamic Bayesian Network for Vehicle Maneuver Prediction in Highway Driving Scenarios: Framework and Verification , 2019, Electronics.

[37]  Matthias Althoff,et al.  Reachability Analysis and its Application to the Safety Assessment of Autonomous Cars , 2010 .