Traffic sign recognition by combining global and local features based on semi‐supervised classification

The legibility of traffic signs has been considered from the beginning of design, and traffic signs are easy to identify for humans. For computer systems, however, identifying traffic signs still poses a challenging problem. Both image-processing and machine-learning algorithms are constantly improving, aimed at better solving this problem. However, with a dramatic increase in the number of traffic signs, labelling a large amount of training data means high cost. Therefore, how to use a small number of labelled traffic sign data reasonably to build an efficient and high-quality traffic sign recognition (TSR) model in the Internet-of-things–based (IOT-based) transport system has been an urgent research goal. Here, the authors propose a novel semi-supervised learning approach combining global and local features for TSR in an IOT-based transport system. In their approach, histograms of oriented gradient, colour histograms (CH), and edge features (EF) are used to build different feature spaces. Meanwhile, on the unlabelled samples, a fusion feature space is found to alleviate the differences between different feature spaces. Extensive evaluations on a collection of signs from the German Traffic Sign Recognition Benchmark (GTSRB) dataset shows that the proposed approach outperforms the others and provides a potential solution for practical applications.

[1]  Johannes Stallkamp,et al.  Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition , 2012, Neural Networks.

[2]  Alexander Wong,et al.  MicronNet: A Highly Compact Deep Convolutional Neural Network Architecture for Real-Time Embedded Traffic Sign Classification , 2018, IEEE Access.

[3]  Ke Lu,et al.  Sparse-Representation-Based Graph Embedding for Traffic Sign Recognition , 2012, IEEE Transactions on Intelligent Transportation Systems.

[4]  Yun Yang,et al.  A robust semi-supervised learning approach via mixture of label information , 2015, Pattern Recognit. Lett..

[5]  Jing Zhang,et al.  Research and Implementation of an Improved Canny Edge Detection Algorithm , 2013 .

[6]  Anton van den Hengel,et al.  Wider or Deeper: Revisiting the ResNet Model for Visual Recognition , 2016, Pattern Recognit..

[7]  Zhi-Hua Zhou,et al.  Tri-training: exploiting unlabeled data using three classifiers , 2005, IEEE Transactions on Knowledge and Data Engineering.

[8]  Oscar Déniz-Suárez,et al.  Face recognition using Histograms of Oriented Gradients , 2011, Pattern Recognit. Lett..

[9]  Michelle M. Hamer Failure prediction: Sensitivity of classification accuracy to alternative statistical methods and variable sets , 1983 .

[10]  Ahmad Mani-Varnosfaderani,et al.  Motor Oil Classification Using Color Histograms and Pattern Recognition Techniques. , 2018, Journal of AOAC International.

[11]  Fatin Zaklouta,et al.  Real-Time Traffic-Sign Recognition Using Tree Classifiers , 2012, IEEE Transactions on Intelligent Transportation Systems.

[12]  George Hripcsak,et al.  Technical Brief: Agreement, the F-Measure, and Reliability in Information Retrieval , 2005, J. Am. Medical Informatics Assoc..

[13]  Sumithra Velupillai,et al.  Developing a standard for de-identifying electronic patient records written in Swedish: Precision, recall and F-measure in a manual and computerized annotation trial , 2009, Int. J. Medical Informatics.

[14]  StallkampJ.,et al.  2012 Special Issue , 2012 .

[15]  Stephen V. Stehman,et al.  Selecting and interpreting measures of thematic classification accuracy , 1997 .

[16]  So Young Sohn,et al.  Data fusion, ensemble and clustering to improve the classification accuracy for the severity of road traffic accidents in Korea , 2003 .

[17]  Jordi Vitrià,et al.  Traffic Sign Recognition Using Evolutionary Adaboost Detection and Forest-ECOC Classification , 2009, IEEE Transactions on Intelligent Transportation Systems.

[18]  Andrea Baronchelli,et al.  Machine Learning the Cryptocurrency Market , 2018, Complex..

[19]  Yun Yang,et al.  An adaptive semi-supervised clustering approach via multiple density-based information , 2017, Neurocomputing.