FPGA based traffic sign detection for automotive camera systems

Advanced driver assistance systems (ADAS) have become very prominent in todays automobiles. The technological advancement of already familiar assistance systems enable the car to now autonomously assess the current situation and react accordingly. In terms of data processing, there is no difference between actually acting i.e. accelerating, braking or steering and just issuing warnings to alert the driver of a dangerous situation. In this paper, we introduce a camera based image processing system for traffic sign detection for FullHD resolution. This system is able to detect speed limit traffic signs but additional traffic signs can be implemented using the same model. The hardware components consist of a Microblaze softcore from Xilinx and an extended IP core for HDMI-in and out signals. The system is implemented on a a Spartan-6-FPGA. For image acquisition, an off-the-shelf car camera is used. The developed system is able to reliably detect traffic signs on short distances on static images as well as on image streams.

[1]  Bob Feng.  Implementing a TMDS Video Interface in the Spartan-6 FPGA , 2010 .

[2]  Wolfgang Rosenstiel,et al.  Design of an automotive traffic sign recognition system targeting a multi-core SoC implementation , 2010, 2010 Design, Automation & Test in Europe Conference & Exhibition (DATE 2010).

[3]  Yan Han,et al.  Real-time traffic sign recognition based on Zynq FPGA and ARM SoCs , 2014, IEEE International Conference on Electro/Information Technology.

[4]  Thomas J. DeLong,et al.  Xilinx, Inc. (A) , 2003 .

[5]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[6]  Amnon Shashua,et al.  A Computer Vision System on a Chip: a case study from the automotive domain , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[7]  R. Khudeev,et al.  A new flood-fill algorithm for closed contour , 2005, 2005 Siberian Conference on Control and Communications.

[8]  Erdal Oruklu,et al.  FPGA-Based Traffic Sign Recognition for Advanced Driver Assistance Systems , 2013 .