Local texture patterns for traffic sign recognition using higher order spectra

A novel traffic sign recognition module is presented.Higher order spectra and texture based features are extracted.Achieved recognition accuracy of 98.89% using k-NN classifier. Traffic sign recognition (TSR) is considered as one of the most important modules of driver assistance system (DAS). It can be used as a decision supporting tool for driver and autonomous vehicles. Eventually, TSR is a large-scale feature learning problem and hence attracted the attention of researchers recently. The essential parameters such as huge training dataset size, recognition accuracy and computational complexity need to be considered while designing a practical TSR system. In this paper, we have used higher order spectra (HOS) coupled with texture based features to develop an efficient TSR model. These features represent the shape and content of the traffic signs clearly. Then a subspace learning method with graph embedding under linear discriminant analysis framework is used to increase the discrimination power between various traffic symbols. As a result the proposed method attained a maximum recognition accuracy of 98.89%. The proposed method is evaluated using two publicly available datasets such as, Belgium traffic sign classification (BTSC) and German traffic sign recognition benchmark (GTSRB). Our experimental results demonstrate that the proposed approach is computationally efficient and shows promising recognition accuracy.

[1]  Saman K. Halgamuge,et al.  Gabor wavelet similarity maps for optimising hierarchical road sign classifiers , 2007, Pattern Recognit. Lett..

[2]  Mani Golparvar-Fard,et al.  Detection, classification, and mapping of U.S. traffic signs using google street view images for roadway inventory management , 2015 .

[3]  Danwei Wang,et al.  Application of BW-ELM model on traffic sign recognition , 2014, Neurocomputing.

[4]  Peng-Yeng Yin,et al.  Maximum entropy-based optimal threshold selection using deterministic reinforcement learning with controlled randomization , 2002, Signal Process..

[5]  Belur V. Dasarathy,et al.  Image characterizations based on joint gray level-run length distributions , 1991, Pattern Recognit. Lett..

[6]  Xiaoou Tang,et al.  Texture information in run-length matrices , 1998, IEEE Trans. Image Process..

[7]  C. M. Lim,et al.  Application of higher order statistics/spectra in biomedical signals--a review. , 2010, Medical engineering & physics.

[8]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[10]  Changshui Zhang,et al.  Traffic Sign Recognition With Hinge Loss Trained Convolutional Neural Networks , 2014, IEEE Transactions on Intelligent Transportation Systems.

[11]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Paul J Carlson,et al.  The Current State of Research on the Long-Term Deterioration of Traffic Signs , 2013 .

[13]  Jürgen Schmidhuber,et al.  Multi-column deep neural network for traffic sign classification , 2012, Neural Networks.

[14]  James F. Greenleaf,et al.  Use of gray value distribution of run lengths for texture analysis , 1990, Pattern Recognit. Lett..

[15]  Mary M. Galloway,et al.  Texture analysis using gray level run lengths , 1974 .

[16]  Francisco López-Ferreras,et al.  Road-Sign Detection and Recognition Based on Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[17]  Ching-Wei Wang,et al.  Boosting-SVM: effective learning with reduced data dimension , 2013, Applied Intelligence.

[18]  Mehmet Celenk,et al.  Higher-order spectra (HOS) invariants for shape recognition , 2001, Pattern Recognit..

[19]  Chrysostomos L. Nikias,et al.  Bispectrum estimation: A parametric approach , 1985, IEEE Trans. Acoust. Speech Signal Process..

[20]  C. M. Lim,et al.  Cardiac state diagnosis using higher order spectra of heart rate variability , 2008, Journal of medical engineering & technology.

[21]  Kun Zhou,et al.  Locality Sensitive Discriminant Analysis , 2007, IJCAI.

[22]  Luc Van Gool,et al.  Traffic sign recognition — How far are we from the solution? , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[23]  Mani Golparvar-Fard,et al.  Segmentation and recognition of roadway assets from car-mounted camera video streams using a scalable non-parametric image parsing method , 2015 .

[24]  Yann LeCun,et al.  Traffic sign recognition with multi-scale Convolutional Networks , 2011, The 2011 International Joint Conference on Neural Networks.

[25]  Daniel Petrisor,et al.  Detection and recognition of traffic signs using Gabor filters , 2011, 2011 34th International Conference on Telecommunications and Signal Processing (TSP).

[26]  Johannes Stallkamp,et al.  Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition , 2012, Neural Networks.

[27]  Pavel Pudil,et al.  Road sign classification using Laplace kernel classifier , 2000, Pattern Recognit. Lett..

[28]  Luc Van Gool,et al.  Sparse Representation Based Projections , 2011, BMVC.

[29]  Anjan Gudigar,et al.  Multiple thresholding and subspace based approach for detection and recognition of traffic sign , 2017, Multimedia Tools and Applications.

[30]  Jesmin F. Khan,et al.  Image Segmentation and Shape Analysis for Road-Sign Detection , 2011, IEEE Transactions on Intelligent Transportation Systems.

[31]  Jason Jianjun Gu,et al.  An Efficient Method for Traffic Sign Recognition Based on Extreme Learning Machine , 2017, IEEE Transactions on Cybernetics.

[32]  Leen-Kiat Soh,et al.  Texture analysis of SAR sea ice imagery using gray level co-occurrence matrices , 1999, IEEE Trans. Geosci. Remote. Sens..

[33]  Fuchun Sun,et al.  Traffic sign recognition using group sparse coding , 2014, Inf. Sci..

[34]  Stanley R. Deans,et al.  Hough Transform from the Radon Transform , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  A.V. Oppenheim,et al.  The importance of phase in signals , 1980, Proceedings of the IEEE.

[36]  B. Boashash,et al.  Pattern recognition using invariants defined from higher order spectra: 2-D image inputs , 1997, IEEE Trans. Image Process..

[37]  Mohamed El Ansari,et al.  Traffic sign detection and recognition based on random forests , 2016, Appl. Soft Comput..

[38]  Jürgen Schmidhuber,et al.  A committee of neural networks for traffic sign classification , 2011, The 2011 International Joint Conference on Neural Networks.

[39]  Ke Lu,et al.  Sparse-Representation-Based Graph Embedding for Traffic Sign Recognition , 2012, IEEE Transactions on Intelligent Transportation Systems.

[40]  Xiaoli Hao,et al.  Robust Traffic Sign Recognition Based on Color Global and Local Oriented Edge Magnitude Patterns , 2014, IEEE Transactions on Intelligent Transportation Systems.

[41]  J. N. Kapur Information of orderα and typeβ , 1968 .

[42]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[43]  Lin-Lin Huang,et al.  Traffic Sign Recognition Using Complementary Features , 2013, 2013 2nd IAPR Asian Conference on Pattern Recognition.

[44]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[45]  Huaguo Zhou,et al.  A Comprehensive Assessment of Highway Inventory Data Collection Methods , 2014 .

[46]  Anjan Gudigar,et al.  Kernel Based Automatic Traffic Sign Detection and Recognition Using SVM , 2012, ICECCS 2012.

[47]  Majid Mirmehdi,et al.  Real-Time Detection and Recognition of Road Traffic Signs , 2012, IEEE Transactions on Intelligent Transportation Systems.

[48]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[49]  Anjan Gudigar,et al.  A review on automatic detection and recognition of traffic sign , 2014, Multimedia Tools and Applications.

[50]  Fatin Zaklouta,et al.  Traffic sign classification using K-d trees and Random Forests , 2011, The 2011 International Joint Conference on Neural Networks.

[51]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[52]  Wangxin Yu,et al.  Characterization of Surface EMG Signal Based on Fuzzy Entropy , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[53]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  M.R. Raghuveer,et al.  Bispectrum estimation: A digital signal processing framework , 1987, Proceedings of the IEEE.

[55]  Pravin Karde,et al.  Traffic Sign Recognition , 2012 .

[56]  Xin Xu,et al.  Traffic Sign Recognition Using Deep Convolutional Networks and Extreme Learning Machine , 2015, IScIDE.

[57]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[58]  A. Rényi On Measures of Entropy and Information , 1961 .

[59]  Mani Golparvar-Fard,et al.  Evaluation of Multiclass Traffic Sign Detection and Classification Methods for U.S. Roadway Asset Inventory Management , 2016, J. Comput. Civ. Eng..

[60]  Alastair R. Allen,et al.  Using self-organising maps in the detection and recognition of road signs , 2009, Image Vis. Comput..

[61]  Jiawei Han,et al.  SRDA: An Efficient Algorithm for Large-Scale Discriminant Analysis , 2008, IEEE Transactions on Knowledge and Data Engineering.

[62]  Fatin Zaklouta,et al.  Real-Time Traffic-Sign Recognition Using Tree Classifiers , 2012, IEEE Transactions on Intelligent Transportation Systems.

[63]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[64]  David G. Stork,et al.  Pattern Classification , 1973 .

[65]  C. Chakraborty,et al.  Yager's measure based fuzzy divergence for microscopic color image segmentation , 2013, 2013 Indian Conference on Medical Informatics and Telemedicine (ICMIT).

[66]  Arturo de la Escalera,et al.  Traffic sign recognition and analysis for intelligent vehicles , 2003, Image Vis. Comput..