An automatic road sign recognition system based on a computational model of human recognition processing

This paper presents an automatic road sign detection and recognition system that is based on a computational model of human visual recognition processing. Road signs are typically placed either by the roadside or above roads. They provide important information for guiding, warning, or regulating the behaviors drivers in order to make driving safer and easier. The proposed recognition system is motivated by human recognition processing. The system consists of three major components: sensory, perceptual, and conceptual analyzers. The sensory analyzer extracts the spatial and temporal information of interest from video sequences. The extracted information then serves as the input stimuli to a spatiotemporal attentional (STA) neural network in the perceptual analyzer. If stimulation continues, focuses of attention will be established in the neural network. Potential features of road signs are then extracted from the image areas corresponding to the focuses of attention. The extracted features are next fed into the conceptual analyzer. The conceptual analyzer is composed of two modules: a category module and an object module. The former uses a configurable adaptive resonance theory (CART) neural network to determine the category of the input stimuli, whereas the later uses a configurable heteroassociative memory (CHAM) neural network to recognize an object in the determined category of objects. The proposed computational model has been used to develop a system for automatically detecting and recognizing road signs from sequences of traffic images. The experimental results revealed both the feasibility of the proposed computational model and the robustness of the developed road sign detection system.

[1]  Massimo Bertozzi,et al.  Performance analysis of a low-cost solution to vision-based obstacle detection , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[2]  Chiou-Shann Fuh,et al.  Driving environmental change detection subsystem in a vision-based driver assistance system , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[3]  W. Ritter,et al.  Traffic sign recognition using colour information , 1995 .

[4]  Charles E. Thorpe,et al.  The YARF system for vision-based road following , 1995 .

[5]  N. H. C. Yung,et al.  Lane detection by orientation and length discrimination , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[6]  Luis Moreno,et al.  Road traffic sign detection and classification , 1997, IEEE Trans. Ind. Electron..

[7]  X. Cufi,et al.  A new approach to real time traffic sign recognition based on colour information , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[8]  Hemant D. Tagare,et al.  A Maximum-Likelihood Strategy for Directing Attention during Visual Search , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Gaurav Sharma,et al.  Digital color imaging , 1997, IEEE Trans. Image Process..

[10]  Charles Leave.  Neural Networks: Algorithms, Applications and Programming Techniques , 1992 .

[11]  Dan R. Ghica,et al.  Recognition of traffic signs by artificial neural network , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[12]  Ren C. Luo,et al.  Pattern analysis for autonomous vehicles with the region- and feature-based neural network: global self-localization and traffic sign recognition , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[13]  R. Chapuis,et al.  Road detection and vehicles tracking by vision for an on-board ACC system in the VELAC vehicle , 2000, Proceedings of the Third International Conference on Information Fusion.

[14]  José M. R. Delgado,et al.  Integrative Activity of the Brain , 1968, The Yale Journal of Biology and Medicine.

[15]  Nasser Kehtarnavaz,et al.  Traffic sign recognition in noisy outdoor scenes , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[16]  P. Arnoul,et al.  Traffic signs localisation for highways inventory from a video camera on board a moving collection van , 1996, Proceedings of Conference on Intelligent Vehicles.

[17]  Azriel Rosenfeld,et al.  Some experiments on variable thresholding , 1979, Pattern Recognit..

[18]  Dae-Seong Kang.  A noise tolerant algorithm for the object recognition of warning system , 1995, Proceedings of 1995 IEEE International Symposium on Information Theory.

[19]  Marco Campani,et al.  Robust method for road sign detection and recognition , 1996, Image Vis. Comput..

[20]  Lutz Priese,et al.  New results on traffic sign recognition , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[21]  Sei-Wang Chen,et al.  DETECTION AND TRACKING OF ROAD SIGNS , 2001 .

[22]  Dariu Gavrila,et al.  Multi-feature hierarchical template matching using distance transforms , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[23]  Nasser Kehtarnavaz,et al.  A real-time histographic approach to road sign recognition , 1996, Proceeding of Southwest Symposium on Image Analysis and Interpretation.

[24]  Wei Li,et al.  Vision navigation of an autonomous vehicle by fuzzy reasoning , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[25]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[26]  T. Asakura,et al.  A study on traffic sign recognition in scene image using genetic algorithms and neural networks , 1996, Proceedings of the 1996 IEEE IECON. 22nd International Conference on Industrial Electronics, Control, and Instrumentation.

[27]  David M. Skapura,et al.  Neural networks - algorithms, applications, and programming techniques , 1991, Computation and neural systems series.

[28]  Sei-Wang Chen,et al.  Automatic change detection of driving environments in a vision-based driver assistance system , 2003, IEEE Trans. Neural Networks.

[29]  C. Martindale,et al.  Cognitive Psychology: A Neural-Network Approach , 1990 .

[30]  R. Janssen,et al.  An adaptive system for traffic sign recognition , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[31]  Antonio Guiducci,et al.  Parametric Model of the Perspective Projection of a Road with Applications to Lane Keeping and 3D Road Reconstruction , 1999, Comput. Vis. Image Underst..

[32]  Si Wei Lu.  Recognition of traffic signs using a multilayer neural network , 1994, 1994 Proceedings of Canadian Conference on Electrical and Computer Engineering.

[33]  Tae Young Choi,et al.  Morphological traffic sign recognitions , 1996, Proceedings of Third International Conference on Signal Processing (ICSP'96).

[34]  J.K. Aggarwal,et al.  Moving obstacle detection from a navigating robot , 1998, IEEE Trans. Robotics Autom..

[35]  Isao Horiba,et al.  Discrimination of the road condition toward understanding of vehicle driving environments , 2001, IEEE Trans. Intell. Transp. Syst..