Improved architecture for traffic sign recognition using a self-regularized activation function: SigmaH

Traffic sign recognition (TSR) is a crucial intelligent transport system. Nowadays, the convolutional neural network has become a vital tool in the conception of a TSR model. In this work, we propose an improved TSR algorithm for the transportation system inspired by the classical model LeNet-5. In this model, firstly, we replace the hyperbolic tangent activation function with a self-regularized non-monotonic activation function called SigmaH $$({\text{SigmaH}}(x) = x\tanh (\sqrt {\sigma \left( x \right)} ))$$ . SigmaH is experimentally validated on various popular benchmarks against the most suitable combinations of architectures and activation functions. Secondly, we use a convolutional block attention module, which is beneficial for extracting the most valuable features using the attention method. Finally, we combine the triplet-center loss with the Softmax activation function as a loss function to maximize the correct recognition rate. The TSR experiments are carried out based on the German Traffic Sign Recognition benchmark. The experimental results demonstrate that the improved LeNet-5 has an identification accuracy rate of 98.25%, and the average processing time per frame is 8 ms. In the meantime, the number of parameters is reduced by more than 51% compared with the classic LeNet-5 model. Our proposed model has remarkable accuracy and high training efficiency compared with other algorithms.

[1]  Yi Lu Murphey,et al.  Traffic sign recognition with transfer learning , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[2]  Baoyu Ma,et al.  Traffic Sign Recognition Method Integrating Multi-Layer Features and Kernel Extreme Learning Machine Classifier , 2019 .

[3]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Guanghui Ren,et al.  Hole-based traffic sign detection method for traffic signs with red rim , 2013, The Visual Computer.

[5]  Shankru Guggari,et al.  Identification of road signs using a novel convolutional neural network , 2020 .

[6]  Wei Cui,et al.  Application of Improved LeNet-5 Network in Traffic Sign Recognition , 2019, ICVIP.

[7]  Xiangyu Zhang,et al.  ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[8]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[9]  Mihai Daniel RADU,et al.  Automatic Traffic Sign Recognition Artificial Inteligence - Deep Learning Algorithm , 2020, 2020 12th International Conference on Electronics, Computers and Artificial Intelligence (ECAI).

[10]  Yi Luo,et al.  Overview Research of Influence of In-Vehicle Intelligent Terminals on Drivers’ Distraction and Driving Safety , 2018 .

[11]  François Chollet,et al.  Keras: The Python Deep Learning library , 2018 .

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Johannes Stallkamp,et al.  Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition , 2012, Neural Networks.

[14]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Diganta Misra,et al.  Mish: A Self Regularized Non-Monotonic Neural Activation Function , 2019, ArXiv.

[16]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[17]  Yi Yang,et al.  Towards Real-Time Traffic Sign Detection and Classification , 2016, IEEE Transactions on Intelligent Transportation Systems.

[18]  Ivan Cruz-Aceves,et al.  Eigen-Gradients for Traffic Sign Recognition , 2013 .

[19]  Johannes Stallkamp,et al.  The German Traffic Sign Recognition Benchmark: A multi-class classification competition , 2011, The 2011 International Joint Conference on Neural Networks.

[20]  Wu He,et al.  A personalized traffic simulation integrating emotion using a driving simulator , 2019, The Visual Computer.

[21]  Zheng Qiumei,et al.  Improved Convolutional Neural Network Based on Fast Exponentially Linear Unit Activation Function , 2019, IEEE Access.

[22]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[23]  Gang Sun,et al.  Squeeze-and-Excitation Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[24]  Yu Qiao,et al.  Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks , 2016, IEEE Signal Processing Letters.

[25]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[26]  StallkampJ.,et al.  2012 Special Issue , 2012 .

[27]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[28]  Song Bai,et al.  Triplet-Center Loss for Multi-view 3D Object Retrieval , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[29]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[30]  Jamal Riffi,et al.  A robust system for road sign detection and classification using LeNet architecture based on convolutional neural network , 2019, Soft Comput..

[31]  Luca Benini,et al.  Efficient image dataset classification difficulty estimation for predicting deep-learning accuracy , 2018, The Visual Computer.

[32]  Quoc V. Le,et al.  Searching for MobileNetV3 , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[33]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Deepika,et al.  Histogram of Oriented Gradients Based Reduced Feature for Traffic Sign Recognition , 2018, 2018 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[35]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[36]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[37]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[38]  Cristina Olaverri-Monreal,et al.  Road Safety: Human Factors Aspects of Intelligent Vehicle Technologies , 2017, SMARTGREENS/VEHITS.

[39]  Hao Li,et al.  Visualizing the Loss Landscape of Neural Nets , 2017, NeurIPS.

[40]  Sergey Andreev,et al.  Dense Moving Fog for Intelligent IoT: Key Challenges and Opportunities , 2018, IEEE Communications Magazine.