Total Recall: Understanding Traffic Signs Using Deep Convolutional Neural Network

Recognizing Traffic Signs using intelligent systems can drastically reduce the number of accidents happening worldwide. With the arrival of Self-driving cars it has become a staple challenge to solve the automatic recognition of Traffic and Hand-held signs in the major streets. Various machine learning techniques like Random Forest, SVM as well as deep learning models have been proposed for classifying traffic signs. Though they reach state-of-the-art performance on a particular dataset, yet fall short of tackling multiple Traffic Sign Recognition benchmarks. In this paper, we propose a novel and one-for-all architecture that aces multiple benchmarks with a better overall score than the state-of-the-art architectures. Our model is made of residual convolutional blocks with hierarchical dilated skip connections joined in steps. Intrinsically, our model achieves 99.33% Accuracy in German traffic sign recognition benchmark and 99.17% Accuracy in Belgian traffic sign classification benchmark, while classifying traffic signs in real time. Moreover, we propose a newly devised dilated residual learning representation technique which is very low in both memory and computational complexity.

[1]  Jürgen Schmidhuber,et al.  Multi-column deep neural network for traffic sign classification , 2012, Neural Networks.

[2]  Bernhard Schölkopf,et al.  The Kernel Trick for Distances , 2000, NIPS.

[3]  Dinesh Babu Jayagopi,et al.  Vehicle Local Position Estimation System , 2015, ArXiv.

[4]  Kyung-Joong Kim,et al.  Design of a visual perception model with edge-adaptive Gabor filter and support vector machine for traffic sign detection , 2013, Expert Syst. Appl..

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Yu-Bin Yang,et al.  Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections , 2016, NIPS.

[7]  Mohamed El Ansari,et al.  Traffic sign detection and recognition based on random forests , 2016, Appl. Soft Comput..

[8]  Thuc D. Nguyen,et al.  Real Time Traffic Sign Detection Using Color and Shape-Based Features , 2010, ACIIDS.

[9]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[10]  Sourajit Saha,et al.  A Lightning fast approach to classify Bangla Handwritten Characters and Numerals using newly structured Deep Neural Network , 2018 .

[11]  Xun Zhang,et al.  Traffic accidents involving fatigue driving and their extent of casualties. , 2016, Accident; analysis and prevention.

[12]  Zoran Kalafatic,et al.  Multiple-dataset traffic sign classification with OneCNN , 2015, 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR).

[13]  Jean Ponce,et al.  A Theoretical Analysis of Feature Pooling in Visual Recognition , 2010, ICML.

[14]  Luc Van Gool,et al.  Multi-view traffic sign detection, recognition, and 3D localisation , 2014, Machine Vision and Applications.

[15]  Xiaolin Hu,et al.  Traffic sign detection based on convolutional neural networks , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[16]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[17]  Prateek Mittal,et al.  Rogue Signs: Deceiving Traffic Sign Recognition with Malicious Ads and Logos , 2018, ArXiv.

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  Alexander Wong,et al.  MicronNet: A Highly Compact Deep Convolutional Neural Network Architecture for Real-Time Embedded Traffic Sign Classification , 2018, IEEE Access.

[20]  Jian Sun,et al.  Convolutional neural networks at constrained time cost , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  John R. Treat,et al.  A study of precrash factors involved in traffic accidents , 1980 .

[22]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[23]  Tao Chen,et al.  Accurate and Efficient Traffic Sign Detection Using Discriminative AdaBoost and Support Vector Regression , 2016, IEEE Transactions on Vehicular Technology.

[24]  Hironobu Fujiyoshi,et al.  Traffic Sign Recognition Using SIFT Features , 2009 .

[25]  Mrinal Haloi,et al.  A novel pLSA based Traffic Signs Classification System , 2015, ArXiv.

[26]  Zhilu Wu,et al.  A robust, coarse-to-fine traffic sign detection method , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[27]  Luc Van Gool,et al.  Sparse Representation Based Projections , 2011, BMVC.

[28]  Ali Sabbir,et al.  Efficient Yet Deep Convolutional Neural Networks for Semantic Segmentation , 2017, 2018 International Symposium on Advanced Intelligent Informatics (SAIN).

[29]  Neil Salkind,et al.  Using SPSS for Windows and Macintosh : Analyzing and Understanding Data , 2004 .

[30]  Wolfgang Rosenstiel,et al.  Driver-Activity Recognition in the Context of Conditionally Autonomous Driving , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[31]  Yann Le Cun,et al.  A Theoretical Framework for Back-Propagation , 1988 .

[32]  Domenec Puig,et al.  A practical approach for detection and classification of traffic signs using Convolutional Neural Networks , 2016, Robotics Auton. Syst..

[33]  Peter H. N. de With,et al.  Color exploitation in hog-based traffic sign detection , 2010, 2010 IEEE International Conference on Image Processing.

[34]  Luc Van Gool,et al.  Traffic sign recognition — How far are we from the solution? , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[35]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[36]  Wei Liu,et al.  ParseNet: Looking Wider to See Better , 2015, ArXiv.

[37]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Majid Mirmehdi,et al.  Traffic sign recognition using MSER and Random Forests , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[39]  Jürgen Schmidhuber,et al.  Highway Networks , 2015, ArXiv.

[40]  Juan Antonio Álvarez,et al.  Deep neural network for traffic sign recognition systems: An analysis of spatial transformers and stochastic optimisation methods , 2018, Neural Networks.

[41]  Amara Dinesh Kumar,et al.  Novel Deep Learning Model for Traffic Sign Detection Using Capsule Networks , 2018, ArXiv.

[42]  Johannes Stallkamp,et al.  Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition , 2012, Neural Networks.

[43]  Thomas B. Moeslund,et al.  Vision-Based Traffic Sign Detection and Analysis for Intelligent Driver Assistance Systems: Perspectives and Survey , 2012, IEEE Transactions on Intelligent Transportation Systems.

[44]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[45]  Dinesh Babu Jayagopi,et al.  A robust lane detection and departure warning system , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[46]  John Hansen Using SPSS for Windows and Macintosh: Analyzing and Understanding Data , 2005 .

[47]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Johannes Stallkamp,et al.  The German Traffic Sign Recognition Benchmark: A multi-class classification competition , 2011, The 2011 International Joint Conference on Neural Networks.

[49]  Xiangyun Hu,et al.  FRACTAL CHARACTERIZATION OF DYNAMIC FRACTURE NETWORK EXTENSION IN POROUS MEDIA , 2017 .

[50]  Changshui Zhang,et al.  Traffic Sign Recognition With Hinge Loss Trained Convolutional Neural Networks , 2014, IEEE Transactions on Intelligent Transportation Systems.

[51]  Ashutosh Kumar Singh,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2010 .

[52]  Cui-Hua Li,et al.  Unifying visual saliency with HOG feature learning for traffic sign detection , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[53]  Fatin Zaklouta,et al.  Real-time traffic sign recognition in three stages , 2014, Robotics Auton. Syst..

[54]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[55]  Yann LeCun,et al.  Traffic sign recognition with multi-scale Convolutional Networks , 2011, The 2011 International Joint Conference on Neural Networks.

[56]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[57]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.