A system for road sign detection, recognition and tracking based on multi-cues hybrid

This paper presents a road signs detection, recognition and tracking system based on multi-cues hybrid. In detection stage, the color and gradient cues are used to segment the interesting regions, and the corner and geometrical cues are used to detect the signs. A pseudo RGB-HSI conversion method without the need of nonlinear transformation is presented for color extraction. In recognition stage, a coarse classification is performed using the corresponding relationship of color and shape, then the Support Vector Machines with Binary Tree Architecture is built to recognize each category of road sign. Furthermore, we present a finite-state machine to decide whether a road sign is really recognized by fusion multi-frame recognition results or not. In order to reduce recognition errors, Lucas-Kanade feature tracker is introduced for road sign tracking. Experimental results in different conditions, including sunny, cloudy, and rainy weather demonstrates that most road signs can be correctly detected and recognized with a high accuracy and a frame rate of approximately 15 frames per second on a standard PC.

[1]  Anton Kummert,et al.  3D Traffic Sign Tracking Using a Particle Filter , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[2]  Ikuko Nishikawa,et al.  Detection and recognition of road signs using simple layered neural networks , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[3]  Visvanathan Ramesh,et al.  A system for traffic sign detection, tracking, and recognition using color, shape, and motion information , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[4]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[5]  A.Z. Kouzani,et al.  A Study on Automatic Recognition of Road Signs , 2006, 2006 IEEE Conference on Cybernetics and Intelligent Systems.

[6]  Wei Liu,et al.  Improved Wavelet Feature Extraction Methods Based on HSV Space for Vehicle Detection , 2007, MVA.

[7]  W. Ritter,et al.  A real-time traffic sign recognition system , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[8]  Miguel Ángel Sotelo,et al.  Fast traffic sign detection and recognition under changing lighting conditions , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[9]  G.K. Siogkas,et al.  Detection, Tracking and Classification of Road Signs in Adverse Conditions , 2006, MELECON 2006 - 2006 IEEE Mediterranean Electrotechnical Conference.

[10]  P. Arnoul,et al.  Traffic signs localisation for highways inventory from a video camera on board a moving collection van , 1996, Proceedings of Conference on Intelligent Vehicles.

[11]  J. Khurshid,et al.  Road Sign Detection and Recognition using Colour Segmentation, Shape Analysis and Template Matching , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[12]  Luis Moreno,et al.  Road traffic sign detection and classification , 1997, IEEE Trans. Ind. Electron..

[13]  S. Lafuente-Arroyo,et al.  Traffic sign shape classification based on Support Vector Machines and the FFT of the signature of blobs , 2007, 2007 IEEE Intelligent Vehicles Symposium.