Road sign detection using eigen colour

A novel colour-based method to detect road signs directly from videos is presented. A road sign is usually painted with different colours to show its functionalities. To detect it, different detectors should be designed to deal with its colour changes. A statistic linear model of colour change space that makes road sign colours be more compact and thus sufficiently concentrated on a smaller area is presented. On this model, only one detector is needed to detect different road signs even though their colours are different. The model is global and can be used to detect any new road signs. The colour model is invariant to different perspective effects and occlusions. After that, a radial basis function (RBF) network is then used to train a classifier to find all possible road sign candidates from road scenes. Furthermore, a verification process is applied to verify each candidate using its contour feature. After verification, a rectification process is used for rectifying each skewed road sign so that its embedded texts can be well segmented and recognised. Due to the filtering effect of the proposed colour model, different road signs can be very efficiently and effectively detected from videos. Experimental results have proved that the proposed method is robust, accurate and powerful in road sign detection.

[1]  H. Fleyeh,et al.  Color detection and segmentation for road and traffic signs , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[2]  Sei-Wang Chen,et al.  Road-sign detection and tracking , 2003, IEEE Trans. Veh. Technol..

[3]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[4]  José Manuel Pastor,et al.  Visual sign information extraction and identification by deformable models for intelligent vehicles , 2004, IEEE Transactions on Intelligent Transportation Systems.

[5]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[6]  Glenn Healey,et al.  Segmenting images using normalized color , 1992, IEEE Trans. Syst. Man Cybern..

[7]  Kuo-Chin Fan,et al.  Vehicle Detection Using Normalized Color and Edge Map , 2007, IEEE Transactions on Image Processing.

[8]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  A. Zelinsky,et al.  Real-time radial symmetry for speed sign detection , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[10]  Marie de Saint Blancard,et al.  Road sign recognition: a study of vision-based decision making for road environment recognition , 1992 .

[11]  Arturo de la Escalera,et al.  Traffic sign recognition and analysis for intelligent vehicles , 2003, Image Vis. Comput..

[12]  M. Benallal,et al.  Real-time color segmentation of road signs , 2003, CCECE 2003 - Canadian Conference on Electrical and Computer Engineering. Toward a Caring and Humane Technology (Cat. No.03CH37436).

[13]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  C. Metz Basic principles of ROC analysis. , 1978, Seminars in nuclear medicine.

[15]  Marco Campani,et al.  Robust method for road sign detection and recognition , 1996, Image Vis. Comput..

[16]  J. D. Crisman,et al.  Vehicle detection in color images , 1999 .

[17]  Filippo Sorbello,et al.  Efficient rapid prototyping of image and video processing algorithms , 2004, Euromicro Symposium on Digital System Design, 2004. DSD 2004..

[18]  Visvanathan Ramesh,et al.  A system for traffic sign detection, tracking, and recognition using color, shape, and motion information , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[19]  Nasser Kehtarnavaz,et al.  Traffic sign recognition in noisy outdoor scenes , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[20]  Luis Moreno,et al.  Road traffic sign detection and classification , 1997, IEEE Trans. Ind. Electron..

[21]  Giovanni Pilato,et al.  Road signs recognition using a dynamic pixel aggregation technique in the HSV color space , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[22]  Miguel Ángel Sotelo,et al.  Fast traffic sign detection and recognition under changing lighting conditions , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[23]  Ismail Haritaoglu,et al.  Real time image enhancement and segmentation for sign/text detection , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[24]  M. Zweig,et al.  Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. , 1993, Clinical chemistry.

[25]  Michalis E. Zervakis,et al.  A survey of video processing techniques for traffic applications , 2003, Image Vis. Comput..

[26]  Yoshiaki Shirai,et al.  An active vision system for real-time traffic sign recognition , 2000, ITSC2000. 2000 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.00TH8493).

[27]  Xilin Chen,et al.  Detection of text on road signs from video , 2005, IEEE Trans. Intell. Transp. Syst..

[28]  Xilin Chen,et al.  Automatic detection and recognition of signs from natural scenes , 2004, IEEE Transactions on Image Processing.

[29]  David G. Stork,et al.  Pattern Classification , 1973 .