Traffic sign detection based on convolutional neural networks

We propose an approach for traffic sign detection based on Convolutional Neural Networks (CNN). We first transform the original image into the gray scale image by using support vector machines, then use convolutional neural networks with fixed and learnable layers for detection and recognition. The fixed layer can reduce the amount of interest areas to detect, and crop the boundaries very close to the borders of traffic signs. The learnable layers can increase the accuracy of detection significantly. Besides, we use bootstrap methods to improve the accuracy and avoid overfitting problem. In the German Traffic Sign Detection Benchmark, we obtained competitive results, with an area under the precision-recall curve(AUC) of 99.73% in the category “Danger”, and an AUC of 97.62% in the category “Mandatory”.

[1]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[2]  Jürgen Schmidhuber,et al.  A committee of neural networks for traffic sign classification , 2011, The 2011 International Joint Conference on Neural Networks.

[3]  Yann LeCun,et al.  EBLearn: Open-Source Energy-Based Learning in C++ , 2009, 2009 21st IEEE International Conference on Tools with Artificial Intelligence.

[4]  Eero P. Simoncelli,et al.  Nonlinear image representation using divisive normalization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  T. Asakura,et al.  A study on traffic sign recognition in scene image using genetic algorithms and neural networks , 1996, Proceedings of the 1996 IEEE IECON. 22nd International Conference on Industrial Electronics, Control, and Instrumentation.

[6]  Chee Siong Teh,et al.  A comparison of RGB and HSI color segmentation in real - time video images: A preliminary study on road sign detection , 2008 .

[7]  Chee Siong Teh,et al.  A comparison of RGB and HSI color segmentation in real - time video images: A preliminary study on road sign detection , 2008, 2008 International Symposium on Information Technology.

[8]  Klaus Zimmermann,et al.  Towards reliable traffic sign recognition , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[9]  Hong-Bin Ma,et al.  A Combined Method for Traffic Sign Detection and Classification , 2010, 2010 Chinese Conference on Pattern Recognition (CCPR).

[10]  Yann LeCun,et al.  Traffic sign recognition with multi-scale Convolutional Networks , 2011, The 2011 International Joint Conference on Neural Networks.

[11]  Jun-Wei Hsieh,et al.  Road sign detection using eigen colour , 2008 .

[12]  W. Ritter.  Traffic sign recognition in color image sequences , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[13]  Yann LeCun,et al.  What is the best multi-stage architecture for object recognition? , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[14]  Xiaolin Hu,et al.  Traffic sign detection by ROI extraction and histogram features-based recognition , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[15]  Pavel Pudil,et al.  Road sign classification using Laplace kernel classifier , 2000, Pattern Recognit. Lett..

[16]  Rachid Belaroussi,et al.  Angle vertex and bisector geometric model for triangular road sign detection , 2009, 2009 Workshop on Applications of Computer Vision (WACV).

[17]  Johannes Stallkamp,et al.  Detection of traffic signs in real-world images: The German traffic sign detection benchmark , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[18]  Jean Ponce,et al.  A Theoretical Analysis of Feature Pooling in Visual Recognition , 2010, ICML.

[19]  Gareth Blake Loy,et al.  Fast shape-based road sign detection for a driver assistance system , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).