Real-Time Speed-Limit Sign Detection and Recognition Using Spatial Pyramid Feature and Boosted Random Forest

Traffic-sign detection and recognition using computer vision is essential for safe driving when using an advanced driver assistance system (ADAS). Among the few types of traffic signs used, in this paper, we focus on the detection and recognition of speed-limit signs because such signs can ensure the safety of drivers and other road users, and facilitate an efficient traffic flow. To detect a speed-limit sign, we first choose the candidate regions for a speed-limit sign using the border color and apply sliding windows to the candidate regions using a two-class boosted random forest (BoostRF) classifier instead of simple random forest. To reduce the computational cost for the image pyramid, the optimal levels of scaling using the search area is adapted. Detected speed-limit signs are fed into the speed-limit sign classifiers based on the multiclass BoostRF. As the feature of the BoostRF, we use spatial pyramid pooling (SPP) based on oriented center symmetric-local binary patterns (OCS-LBP) because SPP is simple and computationally efficient, and maintains the spatial and local information by pooling the local spatial bins. The proposed algorithm was successfully applied to the German Traffic Sign Detection Benchmark (GTSDB) and German Traffic Sign Recognition Benchmark (GTSRB) datasets, and the results show that detection and recognition capabilities of the proposed method are similar or better than those of other methods.

[1]  A. Broggi,et al.  Real Time Road Signs Recognition , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[2]  Johannes Stallkamp,et al.  Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition , 2012, Neural Networks.

[3]  Jürgen Schmidhuber,et al.  Multi-column deep neural network for traffic sign classification , 2012, Neural Networks.

[4]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[5]  Majid Mirmehdi,et al.  Real-Time Detection and Recognition of Road Traffic Signs , 2012, IEEE Transactions on Intelligent Transportation Systems.

[6]  ByoungChul Ko,et al.  Fast Human Detection for Intelligent Monitoring Using Surveillance Visible Sensors , 2014, Sensors.

[7]  Xiaolin Hu,et al.  Traffic sign detection by ROI extraction and histogram features-based recognition , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[8]  Luc Van Gool,et al.  Traffic sign recognition — How far are we from the solution? , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[9]  Yok-Yen Nguwi,et al.  Detection and classification of road signs in natural environments , 2008, Neural Computing and Applications.

[10]  Hironobu Fujiyoshi,et al.  Boosted random forest , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[11]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[12]  Yann LeCun,et al.  Traffic sign recognition with multi-scale Convolutional Networks , 2011, The 2011 International Joint Conference on Neural Networks.

[13]  Johannes Stallkamp,et al.  The German Traffic Sign Recognition Benchmark: A multi-class classification competition , 2011, The 2011 International Joint Conference on Neural Networks.

[14]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2015, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Peter H. N. de With,et al.  Color exploitation in hog-based traffic sign detection , 2010, 2010 IEEE International Conference on Image Processing.

[16]  Johannes Stallkamp,et al.  Detection of traffic signs in real-world images: The German traffic sign detection benchmark , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[17]  Michiel van Ratingen,et al.  The European New Car Assessment Programme , 2014 .

[18]  A. Zelinsky,et al.  Real-time radial symmetry for speed sign detection , 2004, IEEE Intelligent Vehicles Symposium, 2004.