Hardware implementation and validation of a traffic road sign detection and identification system

Reconfigurability and parallel computing capability of field programmable gate array (FPGA) devices are highly exploited in real-time digital image and video processing applications. In this field, real-time traffic road signs detection systems present a huge interest since they help to assist drivers and decrease accidents. In this paper, we propose an FPGA-based hardware implementation of road signs detection and identification system. The proposed system can achieve real-time video constraints while assuring a high-level accuracy in terms of detection rate. The performance of the system in terms of processing latency was evaluated relatively to the reaction distance, the braking distance and the vehicle speed. The evaluation results show that our system can support real-time driving conditions until the speed of 110 km/h. To prove the validity of the proposed implementation, a hardware co-simulation strategy was applied. This is based on the use of Matlab/Xilinx system generator. A comparison of the co-simulation results shows the effectiveness of the developed architecture.

[1]  Karla Brkić,et al.  An overview of traffic sign detection methods , 2010 .

[2]  Abdellatif Mtibaa,et al.  Robust road lanes and traffic signs recognition for driver assistance system , 2015, Int. J. Comput. Sci. Eng..

[3]  C. Ioannidis,et al.  Automatic road sign detecion and classification based on support vector machines and HOG descriptos , 2014 .

[4]  Gareth Blake Loy,et al.  Fast shape-based road sign detection for a driver assistance system , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[5]  Yan Han,et al.  Real-time traffic sign recognition based on Zynq FPGA and ARM SoCs , 2014, IEEE International Conference on Electro/Information Technology.

[6]  Robert W. Brodersen,et al.  An Automated Fixed-Point Optimization Tool in MATLAB XSG/SynDSP Environment , 2011 .

[7]  John D. Owens,et al.  A Template-Based Approach for Real-Time Speed-Limit-Sign Recognition on an Embedded System Using GPU Computing , 2010, DAGM-Symposium.

[8]  FPGA Implementation of Driver Assistance Camera Algorithms Design Issues , 2010 .

[9]  Iping Supriana,et al.  Traffic sign recognition with Color-based Method, shape-arc estimation and SVM , 2011, Proceedings of the 2011 International Conference on Electrical Engineering and Informatics.

[10]  Johannes Stallkamp,et al.  Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition , 2012, Neural Networks.

[11]  Kerem Par,et al.  Real-time Traffic Sign Recognition with Map Fusion on Multicore/Many-core Architectures , 2012 .

[12]  S. Miyata,et al.  Feature Extraction and Recognition for Road Sign Using Dynamic Image Processing , 2008, 2008 3rd International Conference on Innovative Computing Information and Control.

[13]  Luis Moreno,et al.  Road traffic sign detection and classification , 1997, IEEE Trans. Ind. Electron..

[14]  A. Techmer,et al.  Real-time detection of traffic signs on a multi-core processor , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[15]  Mahmoud M. Zadeh,et al.  Localization and recognition of traffic signs for automated vehicle control systems , 1998, Other Conferences.

[16]  Jordi Vitrià,et al.  Background on Traffic Sign Detection and Recognition , 2011 .

[17]  J. C. Moctezuma,et al.  Architecture for filtering images using Xilinx system generator , 2008 .

[18]  Toon Goedemé,et al.  Comparative study of model-based hardware design tools , 2010 .

[19]  Yutaka Fukui,et al.  Region detection using color similarity , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[20]  M.L. Eichner,et al.  Integrated speed limit detection and recognition from real-time video , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[21]  John D. Owens,et al.  Feature-based speed limit sign detection using a graphics processing unit , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[22]  K. Baskaran,et al.  FPGA based audio watermarking - Covert communication , 2011, Microelectron. J..

[23]  Ana Toledo Moreo,et al.  Xilinx System Generator Based HW Components for Rapid Prototyping of Computer Vision SW/HW Systems , 2005, IbPRIA.

[24]  Kamel Besbes,et al.  Efficient algorithm for automatic road sign recognition and its hardware implementation , 2013, Journal of Real-Time Image Processing.

[25]  Danko Antolovic,et al.  Review of the Hough Transform Method, With an Implementation of the Fast Hough Variant for Line Detection , 2008 .

[26]  Stefano Cagnoni,et al.  Real-Time GPU Based Road Sign Detection and Classification , 2012, PPSN.

[27]  Ching-Hao Lai,et al.  An Efficient Real-Time Traffic Sign Recognition System for Intelligent Vehicles with Smart Phones , 2010, 2010 International Conference on Technologies and Applications of Artificial Intelligence.

[28]  Thuc D. Nguyen,et al.  Real Time Traffic Sign Detection Using Color and Shape-Based Features , 2010, ACIIDS.

[29]  Christian Schiekel,et al.  A Fast Traffic Sign Recognition Algorithm for Gray Value Images , 1999, CAIP.

[30]  A. Sreekumar,et al.  support vector machine learning based traffic sign detection and shape classification using Distance to Borders and Distance from Center features , 2008, TENCON 2008 - 2008 IEEE Region 10 Conference.

[31]  Erdal Oruklu,et al.  FPGA-Based Traffic Sign Recognition for Advanced Driver Assistance Systems , 2013 .

[32]  Sei-Wang Chen,et al.  Road-sign detection and tracking , 2003, IEEE Trans. Veh. Technol..

[33]  A. Zelinsky,et al.  Real-time radial symmetry for speed sign detection , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[34]  Francisco J. Rodriguez,et al.  An FPGA-based approach to the automatic generation of VHDL code for industrial control systems applications: A case study of MSOGIs implementation , 2013, Math. Comput. Simul..

[35]  Alastair R. Allen,et al.  Using self-organising maps in the detection and recognition of road signs , 2009, Image Vis. Comput..

[36]  Mohammed G. Vayada,et al.  Hardware Software co-simulation for Image Processing Applications , 2012 .

[37]  Guang Deng,et al.  Grayscale image segmentation for real-time traffic sign recognition: the hardware point of view , 2009, Electronic Imaging.

[38]  Pranjali Kuche,et al.  Traffic Sign Recognition System , 2016 .

[39]  Aini Hussain,et al.  Shape Matching and Color Segmentation Based Traffic Sign Detection System , 2015 .

[40]  M. Srinivasan,et al.  Hot Resistance Estimation for Dry Type Transformer Using Multiple Variable Regression, Multiple Polynomial Regression and Soft Computing Techniques , 2011 .

[41]  L. Boussaid,et al.  An embedded system for real-time traffic sign recognizing , 2008, 2008 3rd International Design and Test Workshop.

[42]  José Manuel Pastor,et al.  Visual sign information extraction and identification by deformable models for intelligent vehicles , 2004, IEEE Transactions on Intelligent Transportation Systems.

[43]  Eran A. Edirisinghe,et al.  Road Sign Segmentation based on Colour Spaces: A Comparative Study , 2010 .

[44]  Mohan M. Trivedi,et al.  N-tree Disjoint-Set Forests for Maximally Stable Extremal Regions , 2006, BMVC.