Traffic sign detection and recognition for intelligent vehicle

In this paper, we propose a computer vision based system for real-time robust traffic sign detection and recognition, especially developed for intelligent vehicle. In detection phase, a color-based segmentation method is used to scan the scene in order to quickly establish regions of interest (ROI). Sign candidates within ROIs are detected by a set of Haar wavelet features obtained from AdaBoost training. Then, the Speeded Up Robust Features (SURF) is applied for the sign recognition. SURF finds local invariant features in a candidate sign and matches these features to the features of template images that exist in data set. The recognition is performed by finding out the template image that gives the maximum number of matches. We have evaluated the proposed system on our intelligent vehicle SmartVII. A recognition accuracy of over 90% in real-time has been achieved.

[1]  A.Z. Kouzani,et al.  Road-Sign Identification Using Ensemble Learning , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[2]  H. Fleyeh,et al.  Color detection and segmentation for road and traffic signs , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[3]  Marco Campani,et al.  Robust method for road sign detection and recognition , 1996, Image Vis. Comput..

[4]  G.K. Siogkas,et al.  Detection, Tracking and Classification of Road Signs in Adverse Conditions , 2006, MELECON 2006 - 2006 IEEE Mediterranean Electrotechnical Conference.

[5]  Stéphane Marchand-Maillet.  Adaptive Multimedia Retrieval: User, Context, and Feedback, 4th International Workshop, AMR 2006, Geneva, Switzerland, July 27-28, 2006, Revised Selected Papers , 2007, Adaptive Multimedia Retrieval.

[6]  Dariu Gavrila,et al.  Real-time object detection for "smart" vehicles , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Visvanathan Ramesh,et al.  A system for traffic sign detection, tracking, and recognition using color, shape, and motion information , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[8]  Arturo de la Escalera,et al.  Traffic sign recognition and analysis for intelligent vehicles , 2003, Image Vis. Comput..

[9]  Nasser Kehtarnavaz,et al.  Stop-sign recognition based on color/shape processing , 1993, Machine Vision and Applications.

[10]  K. Jo,et al.  Automatic Detection and Recognition of Traffic Signs using Geometric Structure Analysis , 2006, 2006 SICE-ICASE International Joint Conference.

[11]  Nasser Kehtarnavaz,et al.  Traffic sign recognition in noisy outdoor scenes , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[12]  Xilin Chen,et al.  Detection of text on road signs from video , 2005, IEEE Trans. Intell. Transp. Syst..

[13]  Yok-Yen Nguwi,et al.  Automatic Road Sign Recognition Using Neural Networks , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[14]  S. Gorzig,et al.  Real time vision for intelligent vehicles , 2001 .

[15]  Lunbo Li,et al.  Identification of Degraded Traffic Sign Symbols Using Multi-class Support Vector Machines , 2007, 2007 International Conference on Mechatronics and Automation.

[16]  Koichi Yamada,et al.  Fast and Robust Traffic Sign Detection , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[17]  A. Techmer,et al.  Classification of traffic signs in real-time on a multi-core processor , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[18]  N.M. Tahir,et al.  A Speed limit Sign Recognition System Using Artificial Neural Network , 2006, 2006 4th Student Conference on Research and Development.

[19]  Sunil Arya,et al.  An optimal algorithm for approximate nearest neighbor searching fixed dimensions , 1998, JACM.

[20]  A. Zelinsky,et al.  Real-time radial symmetry for speed sign detection , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[21]  S. Lafuente-Arroyo,et al.  Traffic sign recognition system for inventory purposes , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[22]  Luc Van Gool,et al.  Interactive Museum Guide: Accurate Retrieval of Object Descriptions , 2006, Adaptive Multimedia Retrieval.

[23]  José Manuel Pastor,et al.  Visual sign information extraction and identification by deformable models for intelligent vehicles , 2004, IEEE Transactions on Intelligent Transportation Systems.

[24]  Bin Ran,et al.  Vision-Based Stop Sign Detection and Recognition System for Intelligent Vehicles , 2001 .

[25]  C. Bahlmann,et al.  Real-time recognition of U.S. speed signs , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[26]  T. Suzuki,et al.  A real-time vision for intelligent vehicles , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.