Improved Traffic Sign Detection and Recognition Algorithm for Intelligent Vehicles

Traffic sign detection and recognition are crucial in the development of intelligent vehicles. An improved traffic sign detection and recognition algorithm for intelligent vehicles is proposed to address problems such as how easily affected traditional traffic sign detection is by the environment, and poor real-time performance of deep learning-based methodologies for traffic sign recognition. Firstly, the HSV color space is used for spatial threshold segmentation, and traffic signs are effectively detected based on the shape features. Secondly, the model is considerably improved on the basis of the classical LeNet-5 convolutional neural network model by using Gabor kernel as the initial convolutional kernel, adding the batch normalization processing after the pooling layer and selecting Adam method as the optimizer algorithm. Finally, the traffic sign classification and recognition experiments are conducted based on the German Traffic Sign Recognition Benchmark. The favorable prediction and accurate recognition of traffic signs are achieved through the continuous training and testing of the network model. Experimental results show that the accurate recognition rate of traffic signs reaches 99.75%, and the average processing time per frame is 5.4 ms. Compared with other algorithms, the proposed algorithm has remarkable accuracy and real-time performance, strong generalization ability and high training efficiency. The accurate recognition rate and average processing time are markedly improved. This improvement is of considerable importance to reduce the accident rate and enhance the road traffic safety situation, providing a strong technical guarantee for the steady development of intelligent vehicle driving assistance.

[1]  Wenyu Liu,et al.  Traffic sign detection and recognition using fully convolutional network guided proposals , 2016, Neurocomputing.

[2]  Joseph F. Coughlin,et al.  In-vehicle technology for self-driving cars: Advantages and challenges for aging drivers , 2014 .

[3]  Anan Banharnsakun,et al.  Multiple traffic sign detection based on the artificial bee colony method , 2018, Evol. Syst..

[4]  Fuchun Sun,et al.  Traffic sign recognition using group sparse coding , 2014, Inf. Sci..

[5]  Liang Zhong,et al.  Robust Traffic-Sign Detection and Classification Using Mobile LiDAR Data With Digital Images , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  Deepika,et al.  Histogram of Oriented Gradients Based Reduced Feature for Traffic Sign Recognition , 2018, 2018 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[7]  Qing Liu,et al.  A Review of Image Recognition with Deep Convolutional Neural Network , 2017, ICIC.

[8]  Yi Luo,et al.  Overview Research of Influence of In-Vehicle Intelligent Terminals on Drivers’ Distraction and Driving Safety , 2018 .

[9]  Ivan Cruz-Aceves,et al.  Eigen-Gradients for Traffic Sign Recognition , 2013 .

[10]  Henry Leung,et al.  Overview of Environment Perception for Intelligent Vehicles , 2017, IEEE Transactions on Intelligent Transportation Systems.

[11]  Zenghui Wang,et al.  Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review , 2017, Neural Computation.

[12]  Cristina Olaverri-Monreal,et al.  Road Safety: Human Factors Aspects of Intelligent Vehicle Technologies , 2017, SMARTGREENS/VEHITS.

[13]  Aini Hussain,et al.  Vision-Based Traffic Sign Detection and Recognition Systems: Current Trends and Challenges , 2019, Sensors.

[14]  Danwei Wang,et al.  Application of BW-ELM model on traffic sign recognition , 2014, Neurocomputing.

[15]  Yoshimitsu Kuroki,et al.  Thai Traffic Sign Detection and Recognition for Driver Assistance , 2018, 2018 Seventh ICT International Student Project Conference (ICT-ISPC).

[16]  Sergey Andreev,et al.  Dense Moving Fog for Intelligent IoT: Key Challenges and Opportunities , 2018, IEEE Communications Magazine.

[17]  Zhitao Xiao,et al.  Traffic Sign Detection Based on Histograms of Oriented Gradients and Boolean Convolutional Neural Networks , 2017, 2017 International Conference on Machine Vision and Information Technology (CMVIT).

[18]  Abdellatif Mtibaa,et al.  Robust road lanes and traffic signs recognition for driver assistance system , 2015, Int. J. Comput. Sci. Eng..

[19]  Ying Li,et al.  Segment-Based Traffic Sign Detection from Mobile Laser Scanning Data , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[20]  Hidehisa Yoshida,et al.  Toward Next Active Safety Technology of Intelligent Vehicle , 2015, J. Robotics Mechatronics.

[21]  Lwin Lwin Oo,et al.  Traffic sign recognition system using feature points , 2018, 2018 12th International Conference on Research Challenges in Information Science (RCIS).

[22]  Fei Yin,et al.  Traffic Sign Recognition Using Perturbation Method , 2014, CCPR.

[23]  Qi Wang,et al.  An Incremental Framework for Video-Based Traffic Sign Detection, Tracking, and Recognition , 2017, IEEE Transactions on Intelligent Transportation Systems.

[24]  Bin Wang,et al.  Vision-Based Traffic Sign Recognition System for Intelligent Vehicles , 2014 .

[25]  Anjan Gudigar,et al.  A review on automatic detection and recognition of traffic sign , 2014, Multimedia Tools and Applications.

[26]  George W. Irwin,et al.  A review on improving the autonomy of unmanned surface vehicles through intelligent collision avoidance manoeuvres , 2012, Annu. Rev. Control..

[27]  Arno Eichberger,et al.  Review of Recent Patents in Integrated Vehicle Safety, Advanced Driver Assistance Systems and Intelligent Transportation Systems , 2010 .

[28]  Jie Zhao,et al.  Development of a LeNet-5 Gas Identification CNN Structure for Electronic Noses , 2019, Sensors.

[29]  Binoy B. Nair,et al.  A Novel Traffic Sign Recognition System Combining Viola–Jones Framework and Deep Learning , 2019, Advances in Intelligent Systems and Computing.

[30]  Qi Wang,et al.  VSSA-NET: Vertical Spatial Sequence Attention Network for Traffic Sign Detection , 2019, IEEE Transactions on Image Processing.

[31]  Guanghui Ren,et al.  Hole-based traffic sign detection method for traffic signs with red rim , 2013, The Visual Computer.

[32]  Zhao Wang,et al.  Robust chinese traffic sign detection and recognition with deep convolutional neural network , 2015, 2015 11th International Conference on Natural Computation (ICNC).

[33]  Luc Van Gool,et al.  Traffic sign recognition — How far are we from the solution? , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[34]  Huei-Yung Lin,et al.  A vision system for traffic sign detection and recognition , 2017, 2017 IEEE 26th International Symposium on Industrial Electronics (ISIE).

[35]  Amara Dinesh Kumar,et al.  Novel Deep Learning Model for Traffic Sign Detection Using Capsule Networks , 2018, ArXiv.

[36]  José Luis Rojo-Álvarez,et al.  Traffic sign segmentation and classification using statistical learning methods , 2015, Neurocomputing.

[37]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Sudha Natarajan,et al.  Traffic sign recognition using weighted multi‐convolutional neural network , 2018, IET Intelligent Transport Systems.

[39]  Ramesh Kulkarni,et al.  Traffic Sign Detection Using Template Matching Technique , 2018, 2018 Fourth International Conference on Computing Communication Control and Automation (ICCUBEA).

[40]  Jason Jianjun Gu,et al.  An Efficient Method for Traffic Sign Recognition Based on Extreme Learning Machine , 2017, IEEE Transactions on Cybernetics.

[41]  Hazem M. El-Bakry,et al.  CNN for Handwritten Arabic Digits Recognition Based on LeNet-5 , 2016, AISI.