Methodology Based on Texture, Color and Shape Features For Traffic Light Detection and Recognition.

Urban roads are very complex. The increase in the flow of vehicles in the cities has contributed to traffic accidents. Researches for accident reduction show that the traffic lights are effective in reducing accidents. Traffic lights can minimize the occurrence of accidents at intersections and crosswalks. The implementation of traffic light signals shows significant advantages, otherwise reveals some problems such as the failure to detect road signs by drivers on urban roads. This fact is related to excessive visual information, the stress of the drivers and/or eyestrain, making the drivers lose their attention. These reasons motivated researches about intelligent vehicles. This work aims to develop a methodology to detect and recognize traffic lights, to be applied in smart vehicles. This methodology can contribute to the Advanced Driver Support Systems (ADAS), which assists drivers, especially those with partial vision impairment. Image processing techniques are used to develop the detection methodology. Back project and global thresholding are combined to find light points. Local thresholding techniques are applied to calculate the symmetry between the radius and the center of the light points to segment the traffic light body. The first step got an average rate of 99% of detection. The features of the traffic lights are extracted using Haralick texture measures, with the inclusion of color and shape information. The data generated by the feature extraction step were pre-processed using the SMOTE technique to balance the database. The recognition and identification of the traffic lights state are made by an artificial neural network using Multilayer-Perceptron (MLP). The backpropagation learning algorithm is used in the network training. The validation results show an average recognition rate of 98%.

[1]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[2]  Pietro Cerri,et al.  Robust real-time traffic light detection and distance estimation using a single camera , 2015, Expert Syst. Appl..

[3]  Farzam Farbiz,et al.  A new similarity measure and back-projection scheme for robust object tracking , 2010, 2010 10th International Symposium on Communications and Information Technologies.

[4]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[5]  Gang Tao,et al.  The recognition and tracking of traffic lights based on color segmentation and CAMSHIFT for intelligent vehicles , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[6]  Fawzi Nashashibi,et al.  Real time visual traffic lights recognition based on Spot Light Detection and adaptive traffic lights templates , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[7]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[8]  Li Yi,et al.  Notice of RetractionTraffic lights recognition based on morphology filtering and statistical classification , 2011, 2011 Seventh International Conference on Natural Computation.

[9]  Tao Jin,et al.  Robust and Real-Time Traffic Lights Recognition in Complex Urban Environments , 2011, Int. J. Comput. Intell. Syst..

[10]  Jungho Lee,et al.  Object tracking method using back-projection of multiple color histogram models , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[11]  Quan Chen,et al.  Robust and real-time traffic light recognition based on hierarchical vision architecture , 2014, 2014 7th International Congress on Image and Signal Processing.

[12]  S. Sathiya,et al.  Real time recognition of traffic light and their signal count-down timings , 2014, International Conference on Information Communication and Embedded Systems (ICICES2014).

[13]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[14]  白能勝 Vision-based vehicle detection for a driver assistance system , 2011 .

[15]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.