Real-time video analysis on an embedded smart camera for traffic surveillance

A smart camera combines video sensing, high-level video processing and communication within a single embedded device. Such cameras are key components in novel surveillance systems. This paper reports on a prototyping development of a smart camera for traffic surveillance. We present its scalable architecture comprised of a CMOS sensor, digital signal processors (DSP), and a network processor. We further discuss the mapping of high-level video processing algorithms to embedded DSP-based platforms and identify typical pitfalls for the porting of software from desktops to embedded platforms. Our mapping strategies are demonstrated on an algorithm for automatic detection of stationary vehicles. This algorithm is migrated from a Matlab-based prototyping implementation to an embedded DSP implementation in our smart camera. Our implemented smart camera prototype streams the video data over an IP-network to a central monitoring station and is able to detect stationary vehicles and blocking cargo on highways within the required real-time constraints of six seconds.

[1]  Gian Luca Foresti,et al.  Multimedia Video-Based Surveillance Systems , 2000 .

[2]  Mahmut T. Kandemir,et al.  Memory system optimization of embedded software , 2003, Proc. IEEE.

[3]  Wonyong Sung,et al.  Implementation of a digital copier using TMS320C6414 VLIW DSP processor , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[4]  Lui Sha.  Upgrading real-time control software in the field , 2003, Proceedings of the IEEE.

[5]  Rex Min,et al.  Power-aware systems , 2000, Conference Record of the Thirty-Fourth Asilomar Conference on Signals, Systems and Computers (Cat. No.00CH37154).

[6]  Michael Jungmann,et al.  Using Automatic Code Generation for Safety-Critical System Development , 2004 .

[7]  Horst Bischof,et al.  Learning spatiotemporal traffic behaviour and traffic patterns for unusual event detection , 2002 .

[8]  François Charot,et al.  Automatic floating-point to fixed-point conversion for DSP code generation , 2002, CASES '02.

[9]  Rudy Lauwereins,et al.  A framework for mapping scalable networked applications on run-time reconfigurable platforms , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[10]  Booncharoen Sirinaovakul,et al.  Introduction to the Special Issue , 2002, Comput. Intell..

[11]  Tarek F. Abdelzaher,et al.  10th IEEE real-time and embedded technology and applications symposium , 2004, SIGBED.

[12]  António de Sousa.  Smart Cameras in Embedded Systems , 2020 .

[13]  Kerem Karadayi,et al.  Strategies for Mapping Algorithms to Mediaprocessors for High Performance , 2003, IEEE Micro.