Fusion of digital map traffic signs and camera-detected signs

In this paper, we present several fusion approaches to merge speed limits reported in digital maps with detected speed limit signs using an onboard camera. Digital maps holding speed limits signs are required to be updated to cover speed limit changes and are unable to support variable speed limits. On the other hand, a camera system placed onboard a vehicular can detect variable speed limits as well as temporary speed limits at construction sites. However, an onboard camera cannot detect implicit speed limits. As such, a combination of digital map and camera system can provide more accurate speed limit information for driver assistance and support vehicle safety features. In this paper, the digital map and camera system are fused to obtain the desired more accurate speed limit information. The fused speed limits as well as those from the individual sources are compared with ground truth data obtained from an extensive measurement campaign spanning over 15000 km driving distance in five European countries. Specifically, five fusion approaches are defined, modeled and evaluated. Four of them are based on prioritizing information while the remaining approach is based on the classical Dempster-Shafer data fusion technique. The performance of the approaches are presented in terms of the percentage of correct speed limit detection with respect to the driving distance. The obtained results clearly show that fusion techniques can significantly increase the amount of correctly detected speed limits. A MATLAB based graphical user interface was designed to load test data, evaluate and present the results as fast and as efficient as possible.

[1]  K. Gerlach,et al.  A precise digital map for GALILEO-based train positioning systems , 2009, 2009 9th International Conference on Intelligent Transport Systems Telecommunications, (ITST).

[2]  R. Schiffer,et al.  INTRODUCTION , 1988, Neurology.

[3]  W. Niehsen,et al.  Vehicle surround sensing based on information fusion of monocular video and digital map , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[4]  Dennis Nienhuser,et al.  A Situation context aware Dempster-Shafer fusion of digital maps and a road sign recognition system , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[5]  Shinya Ishikawa,et al.  Navigation Systems for Passenger Cars , 1986 .

[6]  Kari Sentz,et al.  Combination of Evidence in Dempster-Shafer Theory , 2002 .

[7]  Uwe Franke,et al.  System architecture for an intersection assistant fusing image, map, and GPS information , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[8]  James Llinas,et al.  An introduction to multisensor data fusion , 1997, Proc. IEEE.

[9]  K. Mezger,et al.  ADAS Horizon — How Digital Maps can contribute to Road Safety , 2006 .

[10]  Bruce Hellinga,et al.  Variable Speed Limits: Safety and Operational Impacts of a Candidate Control Strategy for Freeway Applications , 2007, IEEE Transactions on Intelligent Transportation Systems.

[11]  Yoshiyuki Suzuki,et al.  Development of Vibrational Rate Sensor and Navigation System , 1987 .

[12]  Kenji Suzuki,et al.  Navigation Systems Using GPS for Vehicles , 1986 .

[13]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[14]  Dafang Zhuang,et al.  Advances in Multi-Sensor Data Fusion: Algorithms and Applications , 2009, Sensors.