An Automatic Traffic Sign Detection and Recognition System Based on Colour Segmentation, Shape Matching, and SVM

The main objective of this study is to develop an efficient TSDR system which contains an enriched dataset of Malaysian traffic signs. The developed technique is invariant in variable lighting, rotation, translation, and viewing angle and has a low computational time with low false positive rate. The development of the system has three working stages: image preprocessing, detection, and recognition. The system demonstration using a RGB colour segmentation and shape matching followed by support vector machine (SVM) classifier led to promising results with respect to the accuracy of 95.71%, false positive rate (0.9%), and processing time (0.43 s). The area under the receiver operating characteristic (ROC) curves was introduced to statistically evaluate the recognition performance. The accuracy of the developed system is relatively high and the computational time is relatively low which will be helpful for classifying traffic signs especially on high ways around Malaysia. The low false positive rate will increase the system stability and reliability on real-time application.

[1]  Lutz Priese,et al.  On hierarchical color segmentation and applications , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[2]  T. Asakura,et al.  A study on traffic sign recognition in scene image using genetic algorithms and neural networks , 1996, Proceedings of the 1996 IEEE IECON. 22nd International Conference on Industrial Electronics, Control, and Instrumentation.

[3]  Dariu Gavrila,et al.  Traffic Sign Recognition Revisited , 1999, DAGM-Symposium.

[4]  Yoshiaki Shirai,et al.  An active vision system for real-time traffic sign recognition , 2000, ITSC2000. 2000 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.00TH8493).

[5]  Giovanni Pilato,et al.  Road signs recognition using a dynamic pixel aggregation technique in the HSV color space , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[6]  Ikuko Nishikawa,et al.  Detection and recognition of road signs using simple layered neural networks , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[7]  Xiaohong W. Gao,et al.  Vision Models Based Identification of Traffic Signs , 2002, CGIV.

[8]  Sei-Wang Chen,et al.  Road-sign detection and tracking , 2003, IEEE Trans. Veh. Technol..

[9]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[10]  J. Torresen,et al.  Efficient recognition of speed limit signs , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[11]  Robert P. W. Duin,et al.  Building Road-Sign Classifiers Using a Trainable Similarity Measure , 2006, IEEE Transactions on Intelligent Transportation Systems.

[12]  S. Lafuente-Arroyo,et al.  Road Sign Tracking with a Predictive Filter Solution , 2006, IECON 2006 - 32nd Annual Conference on IEEE Industrial Electronics.

[13]  C. Beleznai,et al.  Road Sign Detection from Edge Orientation Histograms , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[14]  Francisco López-Ferreras,et al.  Road-Sign Detection and Recognition Based on Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[15]  Xiaohui Liu,et al.  Detection, Tracking and Recognition of Traffic Signs from Video Input , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[16]  Cheng Liang,et al.  Automatic detection and recognition of traffic signs in stereo images based on features and probabilistic neural networks , 2008, SPIE Photonics Europe.

[17]  Hilario Gómez Moreno,et al.  Traffic sign shape classification and localization based on the normalized FFT of the signature of blobs and 2D homographies , 2008 .

[18]  Klaus Zimmermann,et al.  Towards reliable traffic sign recognition , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[19]  Alastair R. Allen,et al.  Using self-organising maps in the detection and recognition of road signs , 2009, Image Vis. Comput..

[20]  Gustavo Camps-Valls,et al.  Semisupervised Remote Sensing Image Classification With Cluster Kernels , 2009, IEEE Geoscience and Remote Sensing Letters.

[21]  J. Pablo,et al.  Advanced driver assistance system based on computer vision using detection, recognition and tracking of road signs , 2009 .

[22]  Luc Van Gool,et al.  Integrating Object Detection with 3D Tracking Towards a Better Driver Assistance System , 2010, 2010 20th International Conference on Pattern Recognition.

[23]  Sancho Salcedo-Sanz,et al.  A decision support system for the automatic management of keep-clear signs based on support vector machines and geographic information systems , 2010, Expert Syst. Appl..

[24]  Real-Time Traffic Sign Detection: An Evaluation Study , 2010, 2010 20th International Conference on Pattern Recognition.

[25]  D. B. Megherbi,et al.  Automatic detection and recognition of traffic road signs for intelligent autonomous unmanned vehicles for urban surveillance and rescue , 2010, 2010 IEEE International Conference on Technologies for Homeland Security (HST).

[26]  Aini Hussain,et al.  Decision fusion via integrated sensing system for a smart airbag deployment scheme , 2011 .

[27]  Lars Petersson,et al.  Large scale sign detection using HOG feature variants , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[28]  Yang Siyan,et al.  Road-sign segmentation and recognition in natural scenes , 2011, 2011 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC).

[29]  David Fernández Llorca,et al.  Robust traffic signs detection by means of vision and V2I communications , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[30]  Jesmin F. Khan,et al.  Image Segmentation and Shape Analysis for Road-Sign Detection , 2011, IEEE Transactions on Intelligent Transportation Systems.

[31]  Fatin Zaklouta,et al.  Real-Time Traffic-Sign Recognition Using Tree Classifiers , 2012, IEEE Transactions on Intelligent Transportation Systems.

[32]  Majid Mirmehdi,et al.  Real-Time Detection and Recognition of Road Traffic Signs , 2012, IEEE Transactions on Intelligent Transportation Systems.

[33]  Majid Mirmehdi,et al.  Traffic sign recognition using MSER and Random Forests , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[34]  Thomas B. Moeslund,et al.  Vision-Based Traffic Sign Detection and Analysis for Intelligent Driver Assistance Systems: Perspectives and Survey , 2012, IEEE Transactions on Intelligent Transportation Systems.

[35]  A. Mtibaa,et al.  Automatic detection and recognition of road sign for driver assistance system , 2012, 2012 16th IEEE Mediterranean Electrotechnical Conference.

[36]  Nilesh J. Uke.  DETECTION, CLASSIFICATION AND RECOGNITION OF ROAD TRAFFIC SIGNS USING COLOR AND SHAPE , 2012 .

[37]  O. Ghita,et al.  A robust algorithm for detection and classification of traffic signs in video data , 2012, 2012 International Conference on Control, Automation and Information Sciences (ICCAIS).

[38]  Qingquan Li,et al.  Design of a Multi-Sensor Cooperation Travel Environment Perception System for Autonomous Vehicle , 2012, Sensors.

[39]  Bruno Vallet,et al.  Detection and 3D reconstruction of traffic signs from multiple view color images , 2013 .

[40]  Kyung-Joong Kim,et al.  Design of a visual perception model with edge-adaptive Gabor filter and support vector machine for traffic sign detection , 2013, Expert Syst. Appl..

[41]  Cuneyt Akinlar,et al.  Circular traffic sign recognition empowered by circle detection algorithm , 2013, 2013 21st Signal Processing and Communications Applications Conference (SIU).

[42]  Mohammed A. Hannan,et al.  Traffic Sign Classification based on Neural Network for Advance Driver Assistance System , 2014 .

[43]  J. M. Armingol,et al.  TRAFFIC SIGN DETECTION FOR DRIVER SUPPORT SYSTEMS , 2022 .