A Model for Classification of Traffic Signs Using Improved Convolutional Neural Network and Image Enhancement

In an advanced driver assistance system (ADAS), recognition of traffic signs is very important for safety driving. Recently, the convolutional neural networks (CNNs) have presented promising results. In this work, we propose a robust model based on VGG network by adding batch normalization operation. Dropout is also used to reduce the overfitting of the model. Due to the imbalance of the dataset, data augmentation is performed. Then, in order to enhance images, Contrast limited adaptive histogram equalization (CLAHE) and normalization are performed. The performance of the model is evaluated on German traffic sign recognition benchmark (GTSRB) dataset using different performance metrics namely confusion matrix, precision, recall. Experiments results show that, the proposed model reaches a state-of-art accuracy of 99.33 % and surpasses the best human performance of 98.84 %. This model can be used for real world system.

[1]  Mohamed El Ansari,et al.  Traffic sign detection and recognition based on random forests , 2016, Appl. Soft Comput..

[2]  Jürgen Schmidhuber,et al.  Multi-column deep neural network for traffic sign classification , 2012, Neural Networks.

[3]  Saurabh Maheshwari,et al.  Contrast limited adaptive histogram equalization based enhancement for real time video system , 2014, 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[4]  Jie Xiong,et al.  A novel online incremental and decremental learning algorithm based on variable support vector machine , 2019, Cluster Computing.

[5]  Yuantao Chen,et al.  The fire recognition algorithm using dynamic feature fusion and IV-SVM classifier , 2019, Cluster Computing.

[6]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[7]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Jean Ponce,et al.  A Theoretical Analysis of Feature Pooling in Visual Recognition , 2010, ICML.

[10]  Yann LeCun,et al.  Traffic sign recognition with multi-scale Convolutional Networks , 2011, The 2011 International Joint Conference on Neural Networks.

[11]  Changshui Zhang,et al.  Traffic Sign Recognition With Hinge Loss Trained Convolutional Neural Networks , 2014, IEEE Transactions on Intelligent Transportation Systems.

[12]  Liu Yang,et al.  Real-Time Detection and Recognition of Road Traffic Signs using MSER and Random Forests , 2018, Int. J. Online Eng..

[13]  Jürgen Schmidhuber,et al.  A committee of neural networks for traffic sign classification , 2011, The 2011 International Joint Conference on Neural Networks.

[14]  Andrew Beng Jin Teoh,et al.  A new sparse model for traffic sign classification using soft histogram of oriented gradients , 2017, Appl. Soft Comput..

[15]  Alan F. Murray,et al.  International Joint Conference on Neural Networks , 1993 .

[16]  Johannes Stallkamp,et al.  The German Traffic Sign Recognition Benchmark: A multi-class classification competition , 2011, The 2011 International Joint Conference on Neural Networks.

[17]  Fatin Zaklouta,et al.  Real-time traffic sign recognition in three stages , 2014, Robotics Auton. Syst..

[18]  Zhilu Wu,et al.  A hierarchical method for traffic sign classification with support vector machines , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[19]  Jin Wang,et al.  A full convolutional network based on DenseNet for remote sensing scene classification. , 2019, Mathematical biosciences and engineering : MBE.

[20]  K. Suganya Devi,et al.  Enhancing and Classifying Traffic Signs Using Computer Vision and Deep Convolutional Neural Network , 2020, ICML 2020.

[21]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Jin Wang,et al.  Lightweight deep network for traffic sign classification , 2019, Annals of Telecommunications.

[23]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[24]  Xiaoli Hao,et al.  A Cognitively Motivated Method for Classification of Occluded Traffic Signs , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[25]  Meng Lu,et al.  Technical Feasibility of Advanced Driver Assistance Systems (ADAS) for Road Traffic Safety , 2005 .