The recognition and tracking of traffic lights based on color segmentation and CAMSHIFT for intelligent vehicles

The recognition and tracking of traffic lights for intelligent vehicles based on a vehicle-mounted camera are studied in this paper. The candidate region of the traffic light is extracted using the threshold segmentation method and the morphological operation. Then, the recognition algorithm of the traffic light based on machine learning is employed. To avoid false negatives and tracking loss, the target tracking algorithm CAMSHIFT (Continuously Adaptive Mean Shift), which uses the color histogram as the target model, is adopted. In addition to traffic signal pre-processing and the recognition method of learning, the initialization problem of the search window of CAMSHIFT algorithm is resolved. Moreover, the window setting method is used to shorten the processing time of the global HSV color space conversion. The real vehicle experiments validate the performance of the presented approach.

[1]  Gary R. Bradski,et al.  Real time face and object tracking as a component of a perceptual user interface , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[2]  Zhuowen Tu,et al.  AUTOMATIC RECOGNITION OF CIVIL INFRASTRUCTURE OBJECTS IN MOBILE MAPPING IMAGERY USING A MARKOV RANDOM FIELD MODEL , 2000 .

[3]  José Manuel Pastor,et al.  Visual sign information extraction and identification by deformable models for intelligent vehicles , 2004, IEEE Transactions on Intelligent Transportation Systems.

[4]  Umit Ozguner,et al.  A robust video based traffic light detection algorithm for intelligent vehicles , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[5]  Ashutosh Kumar Singh,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2010 .

[6]  N. H. C. Yung,et al.  An effective video analysis method for detecting red light runners , 2001, IEEE Trans. Veh. Technol..

[7]  Shu-Yuan Chen,et al.  Traffic light recognition , 2008 .

[8]  Grantham Pang,et al.  LED location beacon system based on processing of digital images , 2001, IEEE Trans. Intell. Transp. Syst..

[9]  Fawzi Nashashibi,et al.  Real time visual traffic lights recognition based on Spot Light Detection and adaptive traffic lights templates , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[10]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[11]  In-Hak Joo,et al.  Detection of Traffic Lights for Vision-Based Car Navigation System , 2006, PSIVT.

[12]  Nikolaos Papanikolopoulos,et al.  Real-time vehicle following through a novel symmetry-based approach , 1997, Proceedings of International Conference on Robotics and Automation.

[13]  F. Lindner,et al.  Robust recognition of traffic signals , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[14]  Joo In-Hak,et al.  Detection of traffic lights for vision-based car navigation system , 2006 .

[15]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..