Traffic sign recognition using hybrid features descriptor and artificial neural network classifier

Traffic Sign Recognition (TSR) system is a significant component of Intelligent Transport System (ITS) as traffic signs assist the drivers to drive more safely and efficiently. This paper represents a new approach for TSR system using hybrid features formed by two robust features descriptors, named Histogram Oriented Gradient(HOG) features and Speeded Up Robust Features(SURF) and artificial neural network (ANN) classifier. In the detection step, the region of interest (sign area) is segmented using color based thresholding algorithm, post processed to filter the unwanted region. Next robust features vector named Distance to Borders (DtBs) of the segmented blob is formed to verify the shape of the traffic sign. Finally the recognition of the traffic sign is implemented using ANN classifier upon the training of hybrid features descriptor. The proposed system simulated on offline road scene images shows a high classification rate in the recognition stage. The performance of the ANN model is illustrated in terms of cross entropy, confusion matrix and receiver operating characteristic (ROC) curves. In addition, the performance of hybrid feature descriptor is compared with recognition based on HOG and SURF descriptor respectively. Also, performances of some classifier such as Support Vector Machine (SVM), Decision Trees, Ensembles Learners (Adaboost) and K-Nearest Neighbor (KNN) classifier are assessed with ANN approach. The simulation results illustrates that recognition using hybrid feature descriptor outperforms in all classifier and the recognition accuracy of ANN is higher than classifier stated above.

[1]  Jun-Wei Hsieh,et al.  Boosted road sign detection and recognition , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[2]  Faliang Chang,et al.  Fast Traffic Sign Recognition via High-Contrast Region Extraction and Extended Sparse Representation , 2016, IEEE Transactions on Intelligent Transportation Systems.

[3]  Imran Siddiqi,et al.  Detection and Recognition of Traffic Signs from Road Scene Images , 2014, 2014 12th International Conference on Frontiers of Information Technology.

[4]  Yan Han,et al.  Robust traffic sign recognition with feature extraction and k-NN classification methods , 2015, 2015 IEEE International Conference on Electro/Information Technology (EIT).

[5]  Francisco López-Ferreras,et al.  Road-Sign Detection and Recognition Based on Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[6]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[7]  Luis Moreno,et al.  Road traffic sign detection and classification , 1997, IEEE Trans. Ind. Electron..

[8]  Thomas B. Moeslund,et al.  Vision-Based Traffic Sign Detection and Analysis for Intelligent Driver Assistance Systems: Perspectives and Survey , 2012, IEEE Transactions on Intelligent Transportation Systems.

[9]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[10]  Majid Mirmehdi,et al.  Recognizing Text-Based Traffic Signs , 2015, IEEE Transactions on Intelligent Transportation Systems.

[11]  A. Broggi,et al.  Real Time Road Signs Recognition , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[12]  K. Rajeev,et al.  Traffic Sign Detection and Pattern Recognition Using Support Vector Machine , 2009, 2009 Seventh International Conference on Advances in Pattern Recognition.

[13]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[14]  Kaushik Deb,et al.  Bangladeshi road sign detection based on YCbCr color model and DtBs vector , 2015, 2015 International Conference on Computer and Information Engineering (ICCIE).

[15]  Hua Huang,et al.  Automatic Detection and Recognition of Circular Road Sign , 2008, 2008 IEEE/ASME International Conference on Mechtronic and Embedded Systems and Applications.

[16]  R. Mahesh,et al.  Detection and Recognition of Road Traffic Signs , 2016 .

[17]  S. Lafuente-Arroyo,et al.  Traffic sign recognition system for inventory purposes , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[18]  Visvanathan Ramesh,et al.  A system for traffic sign detection, tracking, and recognition using color, shape, and motion information , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[19]  Majid Mirmehdi,et al.  Real-Time Detection and Recognition of Road Traffic Signs , 2012, IEEE Transactions on Intelligent Transportation Systems.

[20]  Fahim Irfan Alam,et al.  A robust approach to the recognition of text based Bangla road sign , 2014, 2014 International Conference on Informatics, Electronics & Vision (ICIEV).