Visual state estimation of traffic lights using hidden Markov models

The comprehension of dynamic objects in the environment is a major concern of prospective assistance systems. Among the relevant dynamic objects are not only road users, but also parts of the traffic infrastructure: Traffic lights switch between different light colors to manage traffic at intersections. We propose a camera-based approach to incorporate the visual information of traffic lights. Assistance systems can use it to realize comfort, fuel economy and safety functions. We focus on the classification and state estimation using support vector machines and hidden Markov models. Our system is able to distinguish different types of traffic lights - even blinking lights - in real-time.

[1]  Uwe Franke,et al.  System architecture for an intersection assistant fusing image, map, and GPS information , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[2]  Y. Chung,et al.  A Vision-Based Traffic Light Detection System at Intersections , 2002 .

[3]  Fawzi Nashashibi,et al.  Real time visual traffic lights recognition based on Spot Light Detection and adaptive traffic lights templates , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[4]  Dennis Nienhuser,et al.  A Situation context aware Dempster-Shafer fusion of digital maps and a road sign recognition system , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[5]  In-Hak Joo,et al.  Detection of Traffic Lights for Vision-Based Car Navigation System , 2006, PSIVT.

[6]  Y.K. Kim,et al.  Real Time Traffic Light Recognition System for Color Vision Deficiencies , 2007, 2007 International Conference on Mechatronics and Automation.

[7]  John H. Lin JOURNAL OF THE CHINESE INSTITUTE OF ENGINEERS , 2011 .

[8]  Dariu M. Gavrila,et al.  6 – From door to door — principles and applications of computer vision for driver assistant systems , 2001 .

[9]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[10]  F. Lindner,et al.  Robust recognition of traffic signals , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[11]  R. Dillmann,et al.  Recognition and attribution of variable message signs and lanes , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[12]  Umit Ozguner,et al.  A robust video based traffic light detection algorithm for intelligent vehicles , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[13]  Rüdiger Dillmann,et al.  Kamera-basierte Erkennung von Geschwindigkeitsbeschränkungen auf deutschen Straßen , 2007, AMS.

[14]  Haiyuan Wu,et al.  Measurement of the length of pedestrian crossings and detection of traffic lights from image data , 2002 .

[15]  Shu-Yuan Chen,et al.  Traffic light recognition , 2008 .