Image Segmentation and Shape Analysis for Road-Sign Detection

This paper proposes an automatic road-sign recognition method based on image segmentation and joint transform correlation (JTC) with the integration of shape analysis. The presented system is universal, which is able to detect traffic signs of any countries with any color and any of the existing shapes (e.g., circular, rectangular, triangular, pentagonal, and octagonal) and is invariant to transformation (e.g., translation, rotation, scale, and occlusion). The main contributions of this paper are: 1) the formulation of two new criteria for analyzing different shapes using two basic geometric properties, 2) the recategorization of the rectangular signs into diamond or nondiamond shapes based on the inclination of the four sides with the ground and 3) the employment of the distortion-invariant fringe-adjusted JTC (FJTC) technique for recognition. There are three main stages in the proposed algorithm: 1) segmentation by clustering the pixels based on the color features to find the regions of interest (ROIs); 2) traffic-sign detection by using two novel shape classification criteria, i.e., the relationship between area and perimeter and the number of sides of a given shape; and 3) recognition of the road sign using FJTC to match the unknown signs with the known reference road signs stored in the database. Experimental results on real-life images show a high success rate and a very low false hit rate and demonstrate that the proposed framework is invariant to translation, rotation, scale, and partial occlusions.

[1]  Julian F. Y. Cheung,et al.  Directional line detectors in correlated noisy environments , 2000, IEEE Trans. Image Process..

[2]  Yoshiaki Shirai,et al.  An active vision system for real-time traffic sign recognition , 2000, ITSC2000. 2000 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.00TH8493).

[3]  José Manuel Pastor,et al.  Visual sign information extraction and identification by deformable models for intelligent vehicles , 2004, IEEE Transactions on Intelligent Transportation Systems.

[4]  Lutz Priese,et al.  Fast and Robust Segmentation of Natural Color Scenes , 1998, ACCV.

[5]  Reinhard Klette,et al.  General traffic sign recognition by feature matching , 2009, 2009 24th International Conference Image and Vision Computing New Zealand.

[6]  Ren C. Luo,et al.  Natural scene segmentation using fractal based autocorrelation , 1992, Proceedings of the 1992 International Conference on Industrial Electronics, Control, Instrumentation, and Automation.

[7]  Xiaohong W. Gao,et al.  Recognition of traffic signs based on their colour and shape features extracted using human vision models , 2006, J. Vis. Commun. Image Represent..

[8]  Lars Petersson,et al.  Boosting a heterogeneous pool of fast HOG features for pedestrian and sign detection , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[9]  D. Forsyth,et al.  A NEW APPROACH FOR ROAD SIGN DETECTION AND RECOGNITION ALGORITHM , 1997 .

[10]  Francisco López-Ferreras,et al.  Road-Sign Detection and Recognition Based on Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[11]  Qi Li,et al.  Interest Points of General Imbalance , 2009, IEEE Transactions on Image Processing.

[12]  Dia I. Abu-Al-Nadi,et al.  Road traffic sign detection in color images , 2003, 10th IEEE International Conference on Electronics, Circuits and Systems, 2003. ICECS 2003. Proceedings of the 2003.

[13]  Rachid Belaroussi,et al.  Angle vertex and bisector geometric model for triangular road sign detection , 2009, 2009 Workshop on Applications of Computer Vision (WACV).

[14]  K. Jo,et al.  Automatic Detection and Recognition of Traffic Signs using Geometric Structure Analysis , 2006, 2006 SICE-ICASE International Joint Conference.

[15]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[16]  Lutz Priese,et al.  Ideogram identification in a realtime traffic sign recognition system , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[17]  M. Benallal,et al.  Real-time color segmentation of road signs , 2003, CCECE 2003 - Canadian Conference on Electrical and Computer Engineering. Toward a Caring and Humane Technology (Cat. No.03CH37436).

[18]  Xilin Chen,et al.  Detection of text on road signs from video , 2005, IEEE Trans. Intell. Transp. Syst..

[19]  Yok-Yen Nguwi,et al.  Automatic Road Sign Recognition Using Neural Networks , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[20]  Sei-Wang Chen,et al.  Road-sign detection and tracking , 2003, IEEE Trans. Veh. Technol..

[21]  Gareth Blake Loy,et al.  Fast shape-based road sign detection for a driver assistance system , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[22]  A. Broggi,et al.  Real Time Road Signs Recognition , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[23]  Ying Sun,et al.  A hierarchical approach to color image segmentation using homogeneity , 2000, IEEE Trans. Image Process..

[24]  Xiaohui Liu,et al.  Towards Real-Time Traffic Sign Recognition by Class-Specific Discriminative Features , 2007, BMVC.

[25]  T. Ueta,et al.  A Study on Contour Line and Internal Area Extraction Method by using the Self-Organization Map , 2006, 2006 International Symposium on Intelligent Signal Processing and Communications.

[26]  Jean-Louis de Bougrenet de la Tocnaye,et al.  Real-time demonstration of an on-board nonlinear joint transform correlator system , 1997 .

[27]  Pavel Pudil,et al.  Road sign classification using Laplace kernel classifier , 2000, Pattern Recognit. Lett..

[28]  Luis Moreno,et al.  Road traffic sign detection and classification , 1997, IEEE Trans. Ind. Electron..

[29]  Ioannis Pratikakis,et al.  Towards Text Recognition in Natural Scene Images , 2005 .

[30]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[31]  Luca Lombardi,et al.  Systolic Formulation for Low-Complexity Serial-Parallel Implementation of Unified Finite Field Multiplication over GF(2 m ) , 2007 .

[32]  M. N. Islam,et al.  Distortion-invariant multiple target detection using class-associative joint transform correlation , 2005 .

[33]  Marco Campani,et al.  Robust method for road sign detection and recognition , 1996, Image Vis. Comput..

[34]  A. R. Rao,et al.  A Taxonomy for Texture Description and Identification , 1990, Springer Series in Perception Engineering.

[35]  Kang-Hyun Jo,et al.  Road Guidance Sign Recognition in Urban Areas by Structure , 2006, 2006 International Forum on Strategic Technology.

[36]  Lutz Priese,et al.  New results on traffic sign recognition , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[37]  Jordi Vitrià,et al.  Traffic Sign Recognition Using Evolutionary Adaboost Detection and Forest-ECOC Classification , 2009, IEEE Transactions on Intelligent Transportation Systems.

[38]  Visvanathan Ramesh,et al.  A system for traffic sign detection, tracking, and recognition using color, shape, and motion information , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[39]  Arturo de la Escalera,et al.  Traffic sign recognition and analysis for intelligent vehicles , 2003, Image Vis. Comput..

[40]  S. Escalera,et al.  Fast greyscale road sign model matching and recognition , 2004 .

[41]  A. Zelinsky,et al.  Real-time radial symmetry for speed sign detection , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[42]  Yoshiaki Shirai,et al.  An Active Vision System for On-Line Traffic Sign Recognition , 2002 .

[43]  R. Marmo,et al.  Milepost sign detection , 2007, 2006 International Workshop on Computer Architecture for Machine Perception and Sensing.

[44]  David Shaw,et al.  Regular polygon detection , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[45]  Xilin Chen,et al.  Automatic detection and recognition of signs from natural scenes , 2004, IEEE Transactions on Image Processing.

[46]  Robert P. W. Duin,et al.  Building Road-Sign Classifiers Using a Trainable Similarity Measure , 2006, IEEE Transactions on Intelligent Transportation Systems.

[47]  Margrit Betke,et al.  Fast object recognition in noisy images using simulated annealing , 1995, Proceedings of IEEE International Conference on Computer Vision.

[48]  Nasser Kehtarnavaz,et al.  An invariant traffic sign recognition system based on sequential color processing and geometrical transformation , 1994, Proceedings of the IEEE Southwest Symposium on Image Analysis and Interpretation.