Vision-Based Traffic Sign Recognition System for Intelligent Vehicles

The recognition of traffic signs in natural environment is a challenging task in computer vision because of the influence of weather conditions, illuminations, locations, vandalism, and other factors. In this paper, we propose a vision-based traffic sign recognition system for the real utilization of intelligent vehicles. The proposed system consists of two phases: detection and recognition. In detection phase, we employ simple vector filter for chromatic/achromatic discrimination and color segmentation followed by shape analysis to roughly divide traffic signs into seven categories according to the color and shape properties. The Pseudo-Zernike moments features of the extracted candidate traffic sign regions are selected for recognition by random forests which combines bootstrap aggregating (bagging) algorithm and random feature selection to construct collections of decision trees and possesses excellent classification ability. The rationality and effectiveness of the proposed system is validated on our intelligent vehicle—Intelligent Pioneer from a great number of experiments.

[1]  Tarak Gandhi,et al.  Looking-In and Looking-Out of a Vehicle: Computer-Vision-Based Enhanced Vehicle Safety , 2007, IEEE Transactions on Intelligent Transportation Systems.

[2]  Wen-Yen Wu,et al.  Extracting Road Signs using the Color Information , 2007 .

[3]  S. Lafuente-Arroyo,et al.  Traffic sign shape classification evaluation. Part II. FFT applied to the signature of blobs , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[4]  Gareth Blake Loy,et al.  Fast shape-based road sign detection for a driver assistance system , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[5]  M. Gokmen,et al.  Traffic sign recognition using Scale Invariant Feature Transform and color classification , 2008, 2008 23rd International Symposium on Computer and Information Sciences.

[6]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[7]  Koichi Yamada,et al.  Fast and Robust Traffic Sign Detection , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[8]  T. Asakura,et al.  Real-time recognition of road traffic sign in moving scene image using new image filter , 2000, SICE 2000. Proceedings of the 39th SICE Annual Conference. International Session Papers (IEEE Cat. No.00TH8545).

[9]  M. Teague Image analysis via the general theory of moments , 1980 .

[10]  C. Caraffi,et al.  Real time road signs classification , 2008, 2008 IEEE International Conference on Vehicular Electronics and Safety.

[11]  M.L. Eichner,et al.  Integrated speed limit detection and recognition from real-time video , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[12]  Xiaohui Liu,et al.  Real-time traffic sign recognition from video by class-specific discriminative features , 2010, Pattern Recognit..

[13]  Antonio Criminisi,et al.  Object Class Recognition at a Glance , 2006 .

[14]  Md. Humayun Kabir,et al.  Automatic detection and recognition of traffic signs , 2010, 2010 IEEE Conference on Robotics, Automation and Mechatronics.

[15]  Tao Wu,et al.  A Method of Fast and Robust for Traffic Sign Recognition , 2009, 2009 Fifth International Conference on Image and Graphics.

[16]  Olac Fuentes,et al.  Color-Based Road Sign Detection and Tracking , 2007, ICIAR.

[17]  Roland T. Chin,et al.  On Image Analysis by the Methods of Moments , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Antonio Fernández-Caballero,et al.  An optimization on pictogram identification for the road-sign recognition task using SVMs , 2010, Comput. Vis. Image Underst..

[19]  Xiaohui Liu,et al.  Robust Class Similarity Measure for Traffic Sign Recognition , 2010, IEEE Transactions on Intelligent Transportation Systems.

[20]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[21]  Chee-Way Chong,et al.  An Efficient Algorithm for Fast Computation of Pseudo-Zernike Moments , 2003, Int. J. Pattern Recognit. Artif. Intell..

[22]  H. Fleyeh,et al.  Traffic sign recognition by fuzzy sets , 2008, 2008 IEEE Intelligent Vehicles Symposium.