Traffic light detection and recognition for autonomous vehicles

Abstract Traffic light detection and recognition is essential for autonomous driving in urban environments. A camera based algorithm for real-time robust traffic light detection and recognition was proposed, and especially designed for autonomous vehicles. Although the current reliable traffic light recognition algorithms operate well under way, most of them are mainly designed for detection at a fixed position and the effect on autonomous vehicles under real-world conditions is still limited. Some methods achieve high accuracy on autonomous vehicle, but they can't work normally without the aid of high-precision priori map. The authors presented a camera-based algorithm for the problem. The image processing flow can be divided into three steps, including pre-processing, detection and recognition. Firstly, red-green-blue (RGB) color space is converted to hue-saturation-value (HSV) as main content of pre-processing. In detection step, the transcendental color threshold method is used for initial filterings, meanwhile, the prior knowledge is performed to scan the scene in order to quickly establish candidate regions. For recognition, this article use histogram of oriented gradients (HOG) features and support vector machine (SVM) as well to recognize the state of traffic light. The proposed system on our autonomous vehicle was evaluated. With voting schemes, the proposed can provide a sufficient accuracy for autonomous vehicles in urban enviroment.

[1]  Sergio A. Velastin,et al.  A Review of Computer Vision Techniques for the Analysis of Urban Traffic , 2011, IEEE Transactions on Intelligent Transportation Systems.

[2]  N. H. C. Yung,et al.  An effective video analysis method for detecting red light runners , 2001, IEEE Trans. Veh. Technol..

[3]  Sebastian Thrun,et al.  Traffic light mapping, localization, and state detection for autonomous vehicles , 2011, 2011 IEEE International Conference on Robotics and Automation.

[4]  Y. Chung,et al.  A Vision-Based Traffic Light Detection System at Intersections , 2002 .

[5]  Gang Tao,et al.  The recognition and tracking of traffic lights based on color segmentation and CAMSHIFT for intelligent vehicles , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[6]  Sebastian Thrun,et al.  Towards fully autonomous driving: Systems and algorithms , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[7]  Michael Himmelsbach,et al.  Autonomous Ground Vehicles—Concepts and a Path to the Future , 2012, Proceedings of the IEEE.