A high-level road model information fusion framework and its application to multi-lane speed limit inference

We propose a high-level road model information fusion framework to combine regulatory traffic elements, e.g. traffic signs, with lane geometry and digital map information for robust inference of lane-specific traffic rules. In this process, special care is given to adequately consider incomplete, uncertain, and inconsistent information sources with i) spatial, ii) existence, and iii) attribute uncertainties. First, Bayesian networks are employed for logical lane assignment of traffic elements under incorporation of traffic regulation knowledge and soft position relation evidences. The position relations are estimated via Monte Carlo simulations by taking spatial lane geometry and existence uncertainties into account. Second, Dempster-Shafer theory is used not only for fusing simultaneously detected traffic signs based on a novel belief mass transfer over adjacent lanes to recover from false sign classifications but also for traffic situation-dependent, lane-specific fusion of digital map attributes with sensor-inferred attributes. The framework is applied to the task of multi-lane speed limit inference, which gives lane-specific speed limit information in form of belief mass functions and runs in real-time on an experimental vehicle.

[1]  Fawzi Nashashibi,et al.  A complete system to determine the speed limit by fusing a GIS and a camera , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[2]  R. Dillmann,et al.  Recognition and attribution of variable message signs and lanes , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[3]  Volker Willert,et al.  Compact Representation of Dynamic Driving Environments for ADAS by Parametric Free Space and Dynamic Object Maps , 2016, IEEE Transactions on Intelligent Transportation Systems.

[4]  Volker Willert,et al.  An Integrated Approach to Maneuver-Based Trajectory Prediction and Criticality Assessment in Arbitrary Road Environments , 2016, IEEE Transactions on Intelligent Transportation Systems.

[5]  Jean-Philippe Lauffenburger,et al.  Conflict management in multi-sensor dempster-shafer fusion for speed limit determination , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[6]  Fawzi Nashashibi,et al.  Navigation and Speed Signs Recognition Fusion for Enhanced Vehicle Location , 2008 .

[7]  Julius Ziegler,et al.  Lanelets: Efficient map representation for autonomous driving , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[8]  Alan N. Steinberg,et al.  Revisions to the JDL data fusion model , 1999, Defense, Security, and Sensing.

[9]  Joel W. Burdick,et al.  Probabilistic Collision Checking With Chance Constraints , 2011, IEEE Transactions on Robotics.

[10]  Alessandro Saffiotti,et al.  The Transferable Belief Model , 1991, ECSQARU.

[11]  Dennis Nienhuser,et al.  A Situation context aware Dempster-Shafer fusion of digital maps and a road sign recognition system , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[12]  Audun Jøsang,et al.  DEMPSTER’S RULE AS SEEN BY LITTLE COLORED BALLS , 2012, Comput. Intell..

[13]  Thomas Gumpp,et al.  Relevance estimation of traffic elements using Markov logic networks , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[14]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[15]  Lars C. Wolf,et al.  RoadGraph: High level sensor data fusion between objects and street network , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[16]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[17]  C. Bahlmann,et al.  Multi-modal speed limit assistants: Combining camera and GPS maps , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[18]  Mirko Meuter,et al.  A Decision Fusion and Reasoning Module for a Traffic Sign Recognition System , 2011, IEEE Transactions on Intelligent Transportation Systems.

[19]  Markus Maurer,et al.  Graph-based context representation, environment modeling and information aggregation for automated driving , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[20]  Jeffrey A. Barnett,et al.  Computational Methods for a Mathematical Theory of Evidence , 1981, IJCAI.

[21]  J. Hammersley,et al.  Monte Carlo Methods , 1965 .

[22]  Hans-Jürgen Zepernick,et al.  Fusion of digital map traffic signs and camera-detected signs , 2011, 2011 5th International Conference on Signal Processing and Communication Systems (ICSPCS).

[23]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[24]  Matthias Schreier,et al.  Automated Detection of Construction Sites on Motorways , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).