Embedded low-level video processing for surveillance purposes

This paper introduces an embedded architecture and the low-level video processing algorithms developed for an intelligent node that is a part of a distributed intelligent sensory network for surveillance purposes. In this paper, details of the architecture developed for this node are given, together with the low-level video processing algorithms used, as well as the results obtained after their implementation. The video board has been developed using two DSP processors for video processing tasks, as well as a FPGA dedicated to image capture (VGA size) and to dispatch them to the DSP processors. The low-level software includes acquisition, segmentation, labeling, tracking and classification of detected objects into three main categories: Person, Group and Luggage. Also, additional features are extracted from each object in the frame. The unit has to communicate the classification results and the main features obtained using XML streaming to upper levels, as well as the processed frames, using a JPEG stream. All these functionalities are currently running in the built prototypes.

[1]  Helmut E. Bez,et al.  A practical adaptive approach for dynamic background subtraction using an invariant colour model and object tracking , 2005, Pattern Recognit. Lett..

[2]  M. Pradhan.  Simplified micro-controller & FPGA platform for DSP applications [educational applications] , 2005, 2005 IEEE International Conference on Microelectronic Systems Education (MSE'05).

[3]  Carlo S. Regazzoni,et al.  Advanced image-processing tools for counting people in tourist site-monitoring applications , 2001, Signal Process..

[4]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[5]  Li Wei,et al.  Design and implementation of a real-time image processing system with modularization and extendibility , 2008, 2008 International Conference on Audio, Language and Image Processing.

[6]  Hamid K. Aghajan,et al.  Application-Oriented Design of Smart Camera Networks , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[7]  Juan Alfonso Rosell Ortega,et al.  Feature Sets for People and Luggage Recognitionin Airport Surveillance Under Real-Time Constraints , 2008, VISAPP.

[8]  H. Khali,et al.  Real-time 3D image computation using LUT-based DSP systems , 2004, The 2004 IEEE Asia-Pacific Conference on Circuits and Systems, 2004. Proceedings..

[9]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Azriel Rosenfeld,et al.  Tracking Groups of People , 2000, Comput. Vis. Image Underst..

[11]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  G.L. Foresti,et al.  Active video-based surveillance system: the low-level image and video processing techniques needed for implementation , 2005, IEEE Signal Processing Magazine.

[13]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Sergio A. Velastin,et al.  From tracking to advanced surveillance , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[15]  Antonio Berlanga,et al.  Video tracking system optimization using evolution strategies , 2007 .

[16]  Hung Hai Bui,et al.  Mutliple camera coordination in a surveillance system , 2003 .

[17]  Chun-Jen Chen,et al.  A linear-time component-labeling algorithm using contour tracing technique , 2004, Comput. Vis. Image Underst..

[18]  Hironobu Fujiyoshi,et al.  Moving target classification and tracking from real-time video , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[19]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[20]  Jesús García,et al.  Video tracking system optimization using evolution strategies , 2007, Int. J. Imaging Syst. Technol..