Real-time traffic sign recognition in three stages

Traffic Sign Recognition (TSR) is an important component of Advanced Driver Assistance Systems (ADAS). The traffic signs enhance traffic safety by informing the driver of speed limits or possible dangers such as icy roads, imminent road works or pedestrian crossings. We present a three-stage real-time Traffic Sign Recognition system in this paper, consisting of a segmentation, a detection and a classification phase. We combine the color enhancement with an adaptive threshold to extract red regions in the image. The detection is performed using an efficient linear Support Vector Machine (SVM) with Histogram of Oriented Gradients (HOG) features. The tree classifiers, K-d tree and Random Forest, identify the content of the traffic signs found. A spatial weighting approach is proposed to improve the performance of the K-d tree. The Random Forest and Fisher's Criterion are used to reduce the feature space and accelerate the classification. We show that only a subset of about one third of the features is sufficient to attain a high classification accuracy on the German Traffic Sign Recognition Benchmark (GTSRB).

[1]  Fatin Zaklouta,et al.  Traffic sign classification using K-d trees and Random Forests , 2011, The 2011 International Joint Conference on Neural Networks.

[2]  Sei-Wang Chen,et al.  Road-sign detection and tracking , 2003, IEEE Trans. Veh. Technol..

[3]  A. Herbin,et al.  Robust on-vehicle real-time visual detection of American and European speed limit signs, with a modular Traffic Signs Recognition system , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[4]  Jordi Vitrià,et al.  Traffic Sign Recognition Using Evolutionary Adaboost Detection and Forest-ECOC Classification , 2009, IEEE Transactions on Intelligent Transportation Systems.

[5]  Liu Tiantian,et al.  A detection and recognition method for prohibition traffic signs , 2010, 2010 International Conference on Image Analysis and Signal Processing.

[6]  Yok-Yen Nguwi,et al.  Detection and classification of road signs in natural environments , 2008, Neural Computing and Applications.

[7]  Yoram Singer,et al.  Pegasos: primal estimated sub-gradient solver for SVM , 2011, Math. Program..

[8]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[9]  A.Z. Kouzani,et al.  Road-Sign Identification Using Ensemble Learning , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[10]  Luke Fletcher,et al.  Real-Time Speed Sign Detection Using the Radial Symmetry Detector , 2008, IEEE Transactions on Intelligent Transportation Systems.

[11]  Xiaohong W. Gao,et al.  Recognition of traffic signs based on their colour and shape features extracted using human vision models , 2006, J. Vis. Commun. Image Represent..

[12]  Johannes Stallkamp,et al.  The German Traffic Sign Recognition Benchmark: A multi-class classification competition , 2011, The 2011 International Joint Conference on Neural Networks.

[13]  C. Beleznai,et al.  Road Sign Detection from Edge Orientation Histograms , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[14]  Frank Lindner,et al.  Autonomous Driving approaches Downtown , 1999 .

[15]  Klaus Zimmermann,et al.  Towards reliable traffic sign recognition , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[16]  Yann LeCun,et al.  Traffic sign recognition with multi-scale Convolutional Networks , 2011, The 2011 International Joint Conference on Neural Networks.

[17]  Francisco López-Ferreras,et al.  Road-Sign Detection and Recognition Based on Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[18]  Peter H. N. de With,et al.  Color exploitation in hog-based traffic sign detection , 2010, 2010 IEEE International Conference on Image Processing.

[19]  Kazuhiko Sumi,et al.  A New Approach for In-Vehicle Camera Traffic Sign Detection and Recognition , 2009, MVA.

[20]  Fatin Zaklouta,et al.  Warning traffic sign recognition using a HOG-based K-d tree , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[21]  S. Lafuente-Arroyo,et al.  Traffic sign shape classification evaluation. Part II. FFT applied to the signature of blobs , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[22]  Kah Phooi Seng,et al.  Intra color-shape classification for traffic sign recognition , 2010, 2010 International Computer Symposium (ICS2010).

[23]  David G. Lowe,et al.  Shape indexing using approximate nearest-neighbour search in high-dimensional spaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  B. Bradai,et al.  Improving pan-European speed-limit signs recognition with a new “global number segmentation” before digit recognition , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[25]  Luis Moreno,et al.  Road traffic sign detection and classification , 1997, IEEE Trans. Ind. Electron..

[26]  Fatih Murat Porikli,et al.  Machine Vision and Applications DOI 10.1007/s00138-009-0231-x ORIGINAL PAPER In-vehicle camera traffic sign detection and recognition , 2022 .

[27]  Dariu Gavrila,et al.  The Issues , 2011 .

[28]  Fatin Zaklouta,et al.  Real-time traffic sign recognition using spatially weighted HOG trees , 2011, 2011 15th International Conference on Advanced Robotics (ICAR).

[29]  Cui-Hua Li,et al.  Unifying visual saliency with HOG feature learning for traffic sign detection , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[30]  Yoram Singer,et al.  Pegasos: primal estimated sub-gradient solver for SVM , 2007, ICML '07.

[31]  Jürgen Schmidhuber,et al.  A committee of neural networks for traffic sign classification , 2011, The 2011 International Joint Conference on Neural Networks.

[32]  Wen-Jia Kuo,et al.  Two-Stage Road Sign Detection and Recognition , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[33]  Xiaohui Liu,et al.  Real-time traffic sign recognition from video by class-specific discriminative features , 2010, Pattern Recognit..