A framework for rapid prototyping of embedded vision applications

We present a framework for fast prototyping of embedded video applications. Starting with a high-level executable specification written in OpenCV, we apply semi-automatic refinements of the specification at various levels (TLM and RTL), the lowest of which is a system-on-chip prototype in FPGA. The refinement leverages the structure of image processing applications to map high-level representations to lower level implementation with limited user intervention. Our framework integrates the computer vision library OpenCV for software, SystemC/TLM for high-level hardware representation, UVM and QEMU-OS for virtual prototyping and verification into a single and uniform design and verification flow. With applications in the field of driving assistance and object recognition, we prove the usability of our framework in producing performance and correct design.

[1]  Suki Kim,et al.  Co-simulation of SystemC TLM with RTL HDL for surveillance camera system verification , 2008, 2008 15th IEEE International Conference on Electronics, Circuits and Systems.

[2]  Stephen Neuendorffer,et al.  Accelerating OpenCV Applications with Zynq using Vivado HLS Video Libraries , 2013 .

[3]  Sankalita Saha,et al.  Design methodology for embedded computer vision systems , 2007 .

[4]  Alberto L. Sangiovanni-Vincentelli,et al.  Interface-based design , 1997, DAC.

[5]  Jason Schlessman,et al.  Hardware/Software Co-Design of an FPGA-based Embedded Tracking System , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[6]  Narciso García,et al.  Line segment detection using weighted mean shift procedures on a 2D slice sampling strategy , 2011, Pattern Analysis and Applications.

[7]  Thomas A. Henzinger,et al.  INTERFACE-BASED DESIGN , 2005 .

[8]  Andrew Hunter,et al.  FPGA-Based Anomalous Trajectory Detection Using SOFM , 2009, ARC.

[9]  Andrej Trost,et al.  Verification structures for design of video processing circuits , 2012, 2012 Proceedings of the 35th International Convention MIPRO.

[10]  F. Catthoor,et al.  System level verification of video and image processing specifications , 1995 .

[11]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[12]  A. Hussain,et al.  Implementation of inverse perspective mapping algorithm for the development of an automatic lane tracking system , 2004, 2004 IEEE Region 10 Conference TENCON 2004..

[13]  Thomas A. Henzinger,et al.  Interface automata , 2001, ESEC/FSE-9.

[14]  Allen Y. Yang,et al.  CITRIC: A low-bandwidth wireless camera network platform , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[15]  Bernhard Rinner,et al.  Distributed embedded smart cameras for surveillance applications , 2006, Computer.

[16]  Bernhard Rinner,et al.  The evolution from single to pervasive smart cameras , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.