A Novel Method for Traffic Sign Recognition Based on DCGAN and MLP With PILAE Algorithm

This paper centers on a novel method for traffic sign recognition (TSR). The method comprises of two major steps: 1) make strong representations for TSR images, by extraction deep features with the deep convolutional generative adversarial networks (DCGANs) and 2) classifier defined by multilayer perceptron (MLP) neural networks trained with a pseudoinverse learning autoencoder (PILAE) algorithm. The PILAE training process is considered efficient in which it does not require the number of hidden layers specified nor does it need the setting of the learning control parameters. This results in the PILAE classifier attaining a better performance in terms of both accuracy and efficiency. Empirical results from the German TSR (GTSRB) and Belgium traffic sign classification (BTSC) have proved that TSR achieves excellent results with other algorithms and reasonably low complexity.

[1]  Quoc V. Le,et al.  Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis , 2011, CVPR 2011.

[2]  Johannes Stallkamp,et al.  Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition , 2012, Neural Networks.

[3]  Thomas B. Moeslund,et al.  Vision-Based Traffic Sign Detection and Analysis for Intelligent Driver Assistance Systems: Perspectives and Survey , 2012, IEEE Transactions on Intelligent Transportation Systems.

[4]  Wenyu Liu,et al.  Traffic sign detection and recognition using fully convolutional network guided proposals , 2016, Neurocomputing.

[5]  Anupam Shukla,et al.  A Novel Genetically Optimized Convolutional Neural Network for Traffic Sign Recognition: A New Benchmark on Belgium and Chinese Traffic Sign Datasets , 2019, Neural Processing Letters.

[6]  Andrew Zisserman,et al.  Automated Flower Classification over a Large Number of Classes , 2008, 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing.

[7]  Honglak Lee,et al.  Unsupervised learning of hierarchical representations with convolutional deep belief networks , 2011, Commun. ACM.

[8]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[9]  Johannes Stallkamp,et al.  The German Traffic Sign Recognition Benchmark: A multi-class classification competition , 2011, The 2011 International Joint Conference on Neural Networks.

[10]  Ali Sabbir,et al.  Total Recall: Understanding Traffic Signs Using Deep Convolutional Neural Network , 2018, 2018 21st International Conference of Computer and Information Technology (ICCIT).

[11]  Luc Van Gool,et al.  Sparse Representation Based Projections , 2011, BMVC.

[12]  C. L. Philip Chen,et al.  Regularization parameter estimation for feedforward neural networks , 2003 .

[13]  Mrinal Haloi,et al.  Traffic Sign Classification Using Deep Inception Based Convolutional Networks , 2015, ArXiv.

[14]  Xiaohui Liu,et al.  Robust Class Similarity Measure for Traffic Sign Recognition , 2010, IEEE Transactions on Intelligent Transportation Systems.

[15]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[16]  Jürgen Schmidhuber,et al.  Multi-column deep neural network for traffic sign classification , 2012, Neural Networks.

[17]  Ping Guo,et al.  Review of Pseudoinverse Learning Algorithm for Multilayer Neural Networks and Applications , 2018, ISNN.

[18]  Yann LeCun,et al.  Traffic sign recognition with multi-scale Convolutional Networks , 2011, The 2011 International Joint Conference on Neural Networks.

[19]  Daniel Petrisor,et al.  Detection and recognition of traffic signs using Gabor filters , 2011, 2011 34th International Conference on Telecommunications and Signal Processing (TSP).

[20]  Danwei Wang,et al.  Application of BW-ELM model on traffic sign recognition , 2014, Neurocomputing.

[21]  Francisco López-Ferreras,et al.  Road-Sign Detection and Recognition Based on Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[22]  Ke Wang,et al.  Autoencoder, low rank approximation and pseudoinverse learning algorithm , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[23]  Jürgen Schmidhuber,et al.  A committee of neural networks for traffic sign classification , 2011, The 2011 International Joint Conference on Neural Networks.

[24]  Changshui Zhang,et al.  Traffic Sign Recognition With Hinge Loss Trained Convolutional Neural Networks , 2014, IEEE Transactions on Intelligent Transportation Systems.

[25]  Luc Van Gool,et al.  Traffic sign recognition — How far are we from the solution? , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[26]  Yan Cui,et al.  Multi-phase Offline Signature Verification System Using Deep Convolutional Generative Adversarial Networks , 2016, 2016 9th International Symposium on Computational Intelligence and Design (ISCID).

[27]  Zhilu Wu,et al.  A hierarchical method for traffic sign classification with support vector machines , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[28]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[29]  Atsuto Maki,et al.  From generic to specific deep representations for visual recognition , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[30]  Hiroaki Mikami,et al.  Massively Distributed SGD: ImageNet/ResNet-50 Training in a Flash , 2018 .

[31]  Yoshua Bengio,et al.  An empirical evaluation of deep architectures on problems with many factors of variation , 2007, ICML '07.

[32]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[33]  Juan Antonio Álvarez,et al.  Deep neural network for traffic sign recognition systems: An analysis of spatial transformers and stochastic optimisation methods , 2018, Neural Networks.

[34]  Antonio Torralba,et al.  HOGgles: Visualizing Object Detection Features , 2013, 2013 IEEE International Conference on Computer Vision.

[35]  Hironobu Fujiyoshi,et al.  Traffic Sign Recognition Using SIFT Features , 2009 .

[36]  Fatin Zaklouta,et al.  Traffic sign classification using K-d trees and Random Forests , 2011, The 2011 International Joint Conference on Neural Networks.

[37]  Honglak Lee,et al.  Sparse deep belief net model for visual area V2 , 2007, NIPS.

[38]  Jiawei Wang,et al.  An unsupervised feature learning approach to improve automatic incident detection , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[39]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[40]  Keegan Kang,et al.  Feature Representation in Convolutional Neural Networks , 2015, ArXiv.

[41]  Ke Lu,et al.  Sparse-Representation-Based Graph Embedding for Traffic Sign Recognition , 2012, IEEE Transactions on Intelligent Transportation Systems.

[42]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[43]  Majid Mirmehdi,et al.  Real-Time Detection and Recognition of Road Traffic Signs , 2012, IEEE Transactions on Intelligent Transportation Systems.

[44]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[46]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[47]  Antonio Torralba,et al.  Recognizing indoor scenes , 2009, CVPR.

[48]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  Xiaoli Hao,et al.  Robust Traffic Sign Recognition Based on Color Global and Local Oriented Edge Magnitude Patterns , 2014, IEEE Transactions on Intelligent Transportation Systems.

[50]  Jing Zhang,et al.  An Efficient Hyperspectral Image Retrieval Method: Deep Spectral-Spatial Feature Extraction with DCGAN and Dimensionality Reduction Using t-SNE-Based NM Hashing , 2018, Remote. Sens..

[51]  Michael R. Lyu,et al.  A pseudoinverse learning algorithm for feedforward neural networks with stacked generalization applications to software reliability growth data , 2004, Neurocomputing.

[52]  Andrew Zisserman,et al.  Spatial Transformer Networks , 2015, NIPS.

[53]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.