Street Sign Recognition Using Histogram of Oriented Gradients and Artificial Neural Networks

Street sign identification is an important problem in applications such as autonomous vehicle navigation and aids for individuals with vision impairments. It can be especially useful in instances where navigation techniques such as global positioning system (GPS) are not available. In this paper, we present a method of detection and interpretation of Malaysian street signs using image processing and machine learning techniques. First, we eliminate the background from an image to segment the region of interest (i.e., the street sign). Then, we extract the text from the segmented image and classify it. Finally, we present the identified text to the user as a voice notification. We also show through experimental results that the system performs well in real-time with a high level of accuracy. To this end, we use a database of Malaysian street sign images captured through an on-board camera.

[1]  Shijian Lu,et al.  Character Recognition in Natural Scenes Using Convolutional Co-occurrence HOG , 2014, 2014 22nd International Conference on Pattern Recognition.

[2]  Ram Gopal Raj,et al.  Recognition of Traffic Sign Based on Bag-of-Words and Artificial Neural Network , 2017, Symmetry.

[3]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[4]  Ram Gopal Raj,et al.  Real-Time (Vision-Based) Road Sign Recognition Using an Artificial Neural Network , 2017, Sensors.

[5]  Nanning Zheng,et al.  Automatic recognition of province name on the license plate of moving vehicle , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[6]  Mikolaj Leszczuk,et al.  Simple solution for public transport route number recognition based on visual information , 2013, 2013 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA).

[7]  Muhammad Younus Javed,et al.  License number plate recognition system using entropy-based features selection approach with SVM , 2018, IET Image Process..

[8]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Azzedine Boukerche,et al.  Road-Sign Text Recognition Architecture for Intelligent Transportation Systems , 2014, 2014 IEEE 80th Vehicular Technology Conference (VTC2014-Fall).

[10]  J. Albert Mayan,et al.  Number plate recognition using template comparison for various fonts in MATLAB , 2016, 2016 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC).

[11]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[12]  A R Smith,et al.  Color Gamut Transformation Pairs , 1978 .

[13]  Kai Wang,et al.  End-to-end scene text recognition , 2011, 2011 International Conference on Computer Vision.

[14]  Luis Miguel Bergasa,et al.  Text recognition on traffic panels from street-level imagery , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[15]  Ioannis Pratikakis,et al.  Detection of artificial and scene text in images and video frames , 2013, Pattern Analysis and Applications.

[16]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[17]  George Nagy,et al.  At the frontiers of OCR , 1992, Proc. IEEE.

[18]  Alvy Ray Smith,et al.  Color gamut transform pairs , 1978, SIGGRAPH.

[19]  Jan-Olof Eklundh,et al.  Reading Street Signs using a Generic Structured Object Detection and Signature Recognition Approach , 2009, VISAPP.

[20]  Juan Miguel Vilar,et al.  Car License Plates Extraction and Recognition Based on Connected Components Analysis and HMM Decoding , 2005, IbPRIA.

[21]  Muhammad Sarfraz,et al.  Saudi Arabian license plate recognition system , 2003, 2003 International Conference on Geometric Modeling and Graphics, 2003. Proceedings.

[22]  Hans Hegt,et al.  A high performance license plate recognition system , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[23]  Muhittin Gökmen,et al.  License Plate Character Segmentation Based on the Gabor Transform and Vector Quantization , 2003, ISCIS.

[24]  Sargur N. Srihari,et al.  On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Palaiahnakote Shivakumara,et al.  Adaptive Histogram Analysis for Scene Text Binarization and Recognition , 2016 .

[26]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[27]  Francisco J. Sánchez-Marín,et al.  Automatic recognition of biological shapes using the Hotelling transform , 2001, Comput. Biol. Medicine.

[28]  Shijian Lu,et al.  Scene Text Recognition Using Co-occurrence of Histogram of Oriented Gradients , 2013, 2013 12th International Conference on Document Analysis and Recognition.

[29]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[30]  Xujun Peng,et al.  Text detection and recognition in natural scenes and consumer videos , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[31]  Ari Visa,et al.  Shape recognition of irregular objects , 1996, Other Conferences.

[32]  Abdelhak Boukharouba,et al.  Novel feature extraction technique for the recognition of handwritten digits , 2017 .

[33]  Dimosthenis Karatzas,et al.  A fast hierarchical method for multi-script and arbitrary oriented scene text extraction , 2014, International Journal on Document Analysis and Recognition (IJDAR).

[34]  Ching Y. Suen,et al.  Historical review of OCR research and development , 1992, Proc. IEEE.

[35]  Nawaf Hazim Barnouti,et al.  Automatic Iraqi license plate recognition system using back propagation neural network (BPNN) , 2017, 2017 Annual Conference on New Trends in Information & Communications Technology Applications (NTICT).

[36]  Gajendra Sharma,et al.  Performance Analysis of Vehicle Number Plate Recognition System Using Template Matching Techniques , 2018 .

[37]  A. Çapar,et al.  License Plate Recognition From Still Images and Video Sequences: A Survey , 2008, IEEE Transactions on Intelligent Transportation Systems.

[38]  Parshuram M. Kamble,et al.  Handwritten Marathi character recognition using R -HOG Feature , 2015 .

[39]  Eric Lecolinet,et al.  A Survey of Methods and Strategies in Character Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Zellig S. Harris,et al.  Distributional Structure , 1954 .

[41]  Ching Y. Suen,et al.  A novel hybrid CNN-SVM classifier for recognizing handwritten digits , 2012, Pattern Recognit..

[42]  Qiang Wu,et al.  Car Plate Detection Using Cascaded Tree-Style Learner Based on Hybrid Object Features , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[43]  Kazuhiko Takahashi,et al.  Remarks on Computational Facial Expression Recognition from HOG Features Using Quaternion Multi-layer Neural Network , 2014, EANN.

[44]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[45]  Pratishtha Gupta,et al.  Number Plate Extraction using Template Matching Technique , 2014 .

[46]  Bo Li,et al.  License plate-location using AdaBoost Algorithm , 2010, The 2010 IEEE International Conference on Information and Automation.