A hardware accelerated configurable ASIP architecture for embedded real-time video-based driver assistance applications

In this paper, a flexible HW architecture for video-based driver assistance applications is presented. It comprises a customizable and extensible processor template and several task-specific HW accelerators. The proposed heterogeneous architecture allows utilization of the programmable processor core for control and low data rate tasks. For the acceleration of computationally intensive tasks of the application, special functional units and custom instructions can be added to the processor template to form an application specific instruction set processor (ASIP). Moreover, dedicated HW accelerators can be attached to the ASIP. To compare the diverse design options, a shape detection application for traffic sign detection is utilized as case study. It is shown that single tasks of a pure software implementation can be significantly accelerated by usage of special functional units by a factor of up to 35 and by usage of HW accelerators of up to 243. The proposed architecture has been mapped onto an FPGA and it could be shown that a realtime capable system can be realized.

[1]  T. Tohara A New Kind of Processor Interface for a System-on-Chip Processor with TIE Ports and TIE Queues of Xtensa LX , 2005, Innovative Architecture for Future Generation High-Performance Processors and Systems (IWIA'05).

[2]  G. Stein,et al.  Challenges and Solutions for Bundling Multiple DAS Applications on a Single Hardware platform , 2008 .

[3]  Peter Pirsch,et al.  Mapping of a Real-Time Object Detection Application onto a Configurable RISC/Coprocessor Architecture at Full HD Resolution , 2010, 2010 International Conference on Reconfigurable Computing and FPGAs.

[4]  Milos D. Ercegovac,et al.  Digital Arithmetic , 2003, Wiley Encyclopedia of Computer Science and Engineering.

[5]  J. M. Pierre Langlois,et al.  Acceleration of a 3D target tracking algorithm using an application specific instruction set processor , 2008, 2008 IEEE International Conference on Computer Design.

[6]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[7]  Amnon Shashua,et al.  A Computer Vision System on a Chip: a case study from the automotive domain , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[8]  Meng-Yin Fu,et al.  A survey of traffic sign recognition , 2010, 2010 International Conference on Wavelet Analysis and Pattern Recognition.

[9]  Yvon Savaria,et al.  High Acceleration for Video Processing Applications Using Specialized Instruction Set Based on Parallelism and Data Reuse , 2009, J. Signal Process. Syst..

[10]  F. Giesemann,et al.  VLIW architecture optimization for an efficient computation of stereoscopic video applications , 2010, The 2010 International Conference on Green Circuits and Systems.

[11]  Peter Pirsch,et al.  A Modular Coprocessor Architecture for Embedded Real-Time Image and Video Signal Processing , 2007, SAMOS.

[12]  Peter Pirsch,et al.  Real-time stereo vision system using semi-global matching disparity estimation: Architecture and FPGA-implementation , 2010, 2010 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation.

[13]  Walter Stechele,et al.  Hardware/software architecture of an algorithm for vision-based real-time vehicle detection in dark environments , 2008, 2008 Design, Automation and Test in Europe.

[14]  Jürgen Teich,et al.  A comparison of embedded reconfigurable video-processing architectures , 2008, 2008 International Conference on Field Programmable Logic and Applications.

[15]  Wen-Yen Wu,et al.  Extracting Road Signs using the Color Information , 2007 .

[16]  Shorin Kyo,et al.  IMAPCAR: A 100 GOPS In-Vehicle Vision Processor Based on 128 Ring Connected Four-Way VLIW Processing Elements , 2011, J. Signal Process. Syst..

[17]  Rudy Lauwereins,et al.  Design, Automation, and Test in Europe , 2008 .

[18]  Atika Rivenq,et al.  Radar based collision avoidance system implementation in a reconfigurable MPSoC , 2009, 2009 9th International Conference on Intelligent Transport Systems Telecommunications, (ITST).