Exploiting Visual Saliency and Bag-of-Words for Road Sign Recognition

In this paper, we propose a novel method for road sign detection and recognition in complex scene real world images. Our algorithm consists of four basic steps. First, we employ a regional contrast based bottom-up visual saliency method to highlight the traffic sign regions, which usually have dominant color contrast against the background. Second, each type of traffic sign has special color distribution, which can be explored by top-down visual saliency to enhance the detection precision and to classify traffic signs into different categories. A bag-of-words (BoW) model and a color name descriptor are employed to compute the specialclass distribution. Third, the candidate road sign blobs are extracted from the final saliency map, which are generated by combining the bottom-up and the top-down saliency maps. Last, the color and shape cues are fused in the BoW model to express blobs, and a support vector machine is employed to recognize road signs. Experiments on real world images show a high success rate and a low false hit rate and demonstrate that the proposed framework is applicable to prohibition, warning and obligation signs. Additionally, our method can be applied to achromatic signs without extra processing. key words: visual saliency, bag-of-words, road sign recognition, color names

[1]  Meeta Kumar,et al.  Techniques for Traffic Sign Classification using Machine Learning- A Survey , 2012 .

[2]  S. M. Hambarde,et al.  Image Segmentation and Shape Analysis for Road Sign Detection , 2014 .

[3]  Xiaohui Liu,et al.  Real-time traffic sign recognition from video by class-specific discriminative features , 2010, Pattern Recognit..

[4]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[5]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Fahad Shahbaz Khan,et al.  Color attributes for object detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Fahad Shahbaz Khan,et al.  Modulating Shape Features by Color Attention for Object Recognition , 2012, International Journal of Computer Vision.

[8]  Cordelia Schmid,et al.  Learning Color Names for Real-World Applications , 2009, IEEE Transactions on Image Processing.

[9]  Jesmin F. Khan,et al.  Image Segmentation and Shape Analysis for Road-Sign Detection , 2011, IEEE Transactions on Intelligent Transportation Systems.

[10]  Mirko Meuter,et al.  A Decision Fusion and Reasoning Module for a Traffic Sign Recognition System , 2011, IEEE Transactions on Intelligent Transportation Systems.

[11]  Hilario Gómez Moreno,et al.  Traffic sign shape classification and localization based on the normalized FFT of the signature of blobs and 2D homographies , 2008 .

[12]  P. Kay,et al.  Basic Color Terms: Their Universality and Evolution , 1973 .

[13]  Lucas Paletta,et al.  Visual Object Detection for Mobile Road Sign Inventory , 2004, Mobile HCI.

[14]  Nick Barnes,et al.  The regular polygon detector , 2010, Pattern Recognit..

[15]  Ying Wu,et al.  A unified approach to salient object detection via low rank matrix recovery , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Zhenmin Tang,et al.  Real time road sign detection based on rotational center voting and shape analysis , 2012, 2012 IEEE International Conference on Mechatronics and Automation.

[17]  Lars Petersson,et al.  Large scale sign detection using HOG feature variants , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[18]  S. Xu,et al.  Robust traffic sign shape recognition using geometric matching , 2009 .

[19]  Kah Phooi Seng,et al.  Colour-based bottom-up saliency for traffic sign detection , 2010, 2010 International Conference on Computer Applications and Industrial Electronics.

[20]  Francisco López-Ferreras,et al.  Road-Sign Detection and Recognition Based on Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[21]  Tao Zhang,et al.  Road sign detection based on visual saliency and shape analysis , 2013, 2013 IEEE International Conference on Image Processing.

[22]  Hongbin Zha,et al.  Salient object detection for searched web images via global saliency , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Minho Lee,et al.  Implementation of road traffic signs detection based on saliency map model , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[24]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  Hiroshi Murase,et al.  Intelligent traffic sign detector: Adaptive learning based on online gathering of training samples , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[26]  Thomas B. Moeslund,et al.  Vision-Based Traffic Sign Detection and Analysis for Intelligent Driver Assistance Systems: Perspectives and Survey , 2012, IEEE Transactions on Intelligent Transportation Systems.

[27]  Gareth Blake Loy,et al.  Fast shape-based road sign detection for a driver assistance system , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[28]  Auranuch Lorsakul,et al.  Traffic Sign Recognition Using Neural Network on OpenCV : Toward Intelligent Vehicle / Driver Assistance System , 2008 .

[29]  Cui-Hua Li,et al.  Unifying visual saliency with HOG feature learning for traffic sign detection , 2009, 2009 IEEE Intelligent Vehicles Symposium.