Detection of traffic signs based on eigen-color model and saliency model in driver assistance systems

Traffic signs are made in many different shapes and colors that normally stand out from their environment for the purpose of enhancing their visibility to drivers. In most previous research, the methods for detecting traffic signs used shape and color information. However, the shape and color information of traffic signs is sensitive to features of the surroundings, such as the viewpoint and changes in the brightness or background, consequently making such information less reliable in terms of accuracy. To solve the problem, this paper presents a method for detecting traffic signs that is invariant under various environmental changes such as those in the appearance and illumination of traffic scenes. This method uses a saliency model to capture those features of traffic signs that are invariant to shading and shadow. Next, a traffic sign color model is used to extract the color features invariant under illumination changes. By using these models, the presented method can identify all possible shapes and colors for similarly representing the traffic signs. Finally, the traffic signs are detected through a so-called object verification process in which each traffic sign can be recognized by finding a region of overlap between two selected candidate regions. Automatic detection of traffic signs by implementing the presented approach has been examined with traffic scenes of some roads. In particular, the detection rate for traffic signs was 92%, while the processing time per frame was 0.27s.

[1]  Robert B. Fisher,et al.  Object-based visual attention for computer vision , 2003, Artif. Intell..

[2]  José Manuel Pastor,et al.  Visual sign information extraction and identification by deformable models for intelligent vehicles , 2004, IEEE Transactions on Intelligent Transportation Systems.

[3]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[4]  Marco Campani,et al.  Robust method for road sign detection and recognition , 1996, Image Vis. Comput..

[5]  H. Fleyeh,et al.  A contour-based separation of vertically attached traffic signs , 2008, 2008 34th Annual Conference of IEEE Industrial Electronics.

[6]  S. Treue Visual attention: the where, what, how and why of saliency , 2003, Current Opinion in Neurobiology.

[7]  Xiaohui Liu,et al.  Robust Class Similarity Measure for Traffic Sign Recognition , 2010, IEEE Transactions on Intelligent Transportation Systems.

[8]  T. Kanade,et al.  Color information for region segmentation , 1980 .

[9]  Antonio Torralba,et al.  Top-down control of visual attention in object detection , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[10]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[11]  L. Salgado,et al.  On-road visual vehicle tracking using Markov chain Monte Carlo particle filtering with metropolis sampling , 2012 .

[12]  Christian Schiekel,et al.  A Fast Traffic Sign Recognition Algorithm for Gray Value Images , 1999, CAIP.

[13]  H. Fleyeh,et al.  Invariant Road Sign Recognition with Fuzzy ARTMAP and Zernike Moments , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[14]  Nasser Kehtarnavaz,et al.  Stop-sign recognition based on color/shape processing , 1993, Machine Vision and Applications.

[15]  Xiaohong W. Gao,et al.  Recognition of traffic signs based on their colour and shape features extracted using human vision models , 2006, J. Vis. Commun. Image Represent..

[16]  Jana Novovičová,et al.  Road Sign Classification without Color Information , 2000 .

[17]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[18]  Yen-Feng Li,et al.  Vision-based vehicle detection for a driver assistance system , 2011, Comput. Math. Appl..

[19]  Majid Nili Ahmadabadi,et al.  Online learning of task-driven object-based visual attention control , 2010, Image Vis. Comput..

[20]  Se-Young Oh,et al.  Driving environment assessment using fusion of in- and out-of-vehicle vision systems , 2009 .

[21]  Xiaohui Liu,et al.  Real-time traffic sign recognition from video by class-specific discriminative features , 2010, Pattern Recognit..

[22]  Harald Jung,et al.  Sensor fusion-based lane detection for LKS+ACC system , 2009 .

[23]  Filippo Sorbello,et al.  Pictogram road signs detection and understanding in outdoor scenes , 1998 .

[24]  Marc Ebner A parallel algorithm for color constancy , 2004, J. Parallel Distributed Comput..

[25]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[26]  Man Ho Kim,et al.  On-road assessment of in-vehicle driving workload for older drivers: Design guidelines for intelligent vehicles , 2011 .

[27]  Joost van de Weijer,et al.  Edge and corner detection by photometric quasi-invariants , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Meng-Yin Fu,et al.  A survey of traffic sign recognition , 2010, 2010 International Conference on Wavelet Analysis and Pattern Recognition.

[29]  José Manuel Pastor,et al.  IVVI: Intelligent vehicle based on visual information , 2007, Robotics Auton. Syst..

[30]  Sei-Wang Chen,et al.  A road sign recognition system based on dynamic visual model , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[31]  Patrick Le Callet,et al.  From low-level perception to high-level perception: a coherent approach for visual attention modeling , 2004, IS&T/SPIE Electronic Imaging.

[32]  Jun-Wei Hsieh,et al.  Road sign detection using eigen colour , 2008 .

[33]  Jong-Bae Kim Real-time Moving Object Recognition and Tracking Using The Wavelet-based Neural Network and Invariant Moments , 2008 .

[34]  Joost van de Weijer,et al.  Boosting color saliency in image feature detection , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Arturo de la Escalera,et al.  Traffic sign recognition and analysis for intelligent vehicles , 2003, Image Vis. Comput..

[36]  Sei-Wang Chen,et al.  Road-sign detection and tracking , 2003, IEEE Trans. Veh. Technol..

[37]  H. Fleyeh Shadow And Highlight Invariant Colour Segmentation Algorithm For Traffic Signs , 2006, 2006 IEEE Conference on Cybernetics and Intelligent Systems.

[38]  Joost van de Weijer,et al.  Author Manuscript, Published in "ieee Transactions on Image Processing Edge-based Color Constancy , 2022 .

[39]  Nasser Kehtarnavaz,et al.  A real-time histographic approach to road sign recognition , 1996, Proceeding of Southwest Symposium on Image Analysis and Interpretation.

[40]  Gyeonghwan Kim,et al.  Robust detection of preceding vehicles in crowded traffic conditions , 2012 .

[41]  Sei-Wang Chen,et al.  Critical Motion Detection of Nearby Moving Vehicles in a Vision-Based Driver-Assistance System , 2009, IEEE Transactions on Intelligent Transportation Systems.