Towards real-time traffic sign detection and classification

This paper aims to deal with real-time traffic sign recognition, i.e. localizing what type of traffic sign appears in which area of an input image at a fast processing time. To achieve this goal, a two-module framework (detection module and classification module) is proposed. In detection module, we firstly transform the input color image to probability maps by using color probability model. Then the traffic sign proposals are extracted by finding maximally stable extremal regions on these maps. Finally, an SVM classifier which trained with color HOG features is utilized to further filter out the false positives and classify the remaining proposals to their super classes. In classification module, we use CNN to classify the detected signs to their sub-classes within each super class. Experiments on the GTSDB benchmark show that our method achieves comparable performance to the state-of-the-art methods with significantly improved computational efficiency, which is 20 times faster than the existing best method.

[1]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[2]  Johannes Stallkamp,et al.  The German Traffic Sign Recognition Benchmark: A multi-class classification competition , 2011, The 2011 International Joint Conference on Neural Networks.

[3]  Fatin Zaklouta,et al.  Traffic sign classification using K-d trees and Random Forests , 2011, The 2011 International Joint Conference on Neural Networks.

[4]  Johannes Stallkamp,et al.  Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition , 2012, Neural Networks.

[5]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[6]  Thomas B. Moeslund,et al.  Vision-Based Traffic Sign Detection and Analysis for Intelligent Driver Assistance Systems: Perspectives and Survey , 2012, IEEE Transactions on Intelligent Transportation Systems.

[7]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[9]  Jürgen Schmidhuber,et al.  A committee of neural networks for traffic sign classification , 2011, The 2011 International Joint Conference on Neural Networks.

[10]  Clément Farabet,et al.  Torch7: A Matlab-like Environment for Machine Learning , 2011, NIPS 2011.

[11]  Zhilu Wu,et al.  A robust, coarse-to-fine traffic sign detection method , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[12]  Zhilu Wu,et al.  A hierarchical method for traffic sign classification with support vector machines , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[13]  Federico Tombari,et al.  A traffic sign detection pipeline based on interest region extraction , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[14]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[15]  Xiaolin Hu,et al.  Traffic sign detection based on convolutional neural networks , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[16]  Pietro Perona,et al.  Integral Channel Features , 2009, BMVC.

[17]  Yann LeCun,et al.  Traffic sign recognition with multi-scale Convolutional Networks , 2011, The 2011 International Joint Conference on Neural Networks.

[18]  Peter H. N. de With,et al.  Color exploitation in hog-based traffic sign detection , 2010, 2010 IEEE International Conference on Image Processing.

[19]  Johannes Stallkamp,et al.  Detection of traffic signs in real-world images: The German traffic sign detection benchmark , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[20]  Xiaolin Hu,et al.  Traffic sign detection by ROI extraction and histogram features-based recognition , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[21]  Jürgen Schmidhuber,et al.  Multi-column deep neural network for traffic sign classification , 2012, Neural Networks.

[22]  Yi Yang,et al.  Real-Time Traffic Sign Detection via Color Probability Model and Integral Channel Features , 2014, CCPR.