The design of a wireless real-time visual surveillance system

In this paper, we study the important issues in the design of an efficient wireless real-time visual surveillance system (WISES). Two important considerations are to minimize: (1) the video workload on the wireless network; and (2) the processing workload at the front-end video capturing unit. To achieve the first objective, we propose a cooperative framework for semantic filtering of video frames instead of forwarding every video frame to the back-end server for analysis and monitoring query evaluation. To minimize the processing workload at the front-end unit, a hierarchical object model (HOM) is designed to model the status of the objects, and their temporal and spatial properties in the video scene. With the information provided from the back-end server, the front-end unit pre-analyses the current status of the objects in the HOM by comparing the selection conditions in the submitted monitoring queries following the adaptive object-based evaluation (APOBE) scheme which is proposed to reduce the processing workload at the front-end unit. In APOBE, a higher evaluation frequency is given to the object which is closer to satisfy the condition in the monitoring queries. The performance of WISES has been studied to demonstrate the efficiency of the proposed scheme.

[1]  James L. Crowley,et al.  Event-based Activity Analysis in Live Video Using a Generic Object Tracker , 2002 .

[2]  H. Niemann,et al.  Adaptive change detection for real-time surveillance applications , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[3]  Pradeep K. Khosla,et al.  Collaborative surveillance using both fixed and mobile unattended ground sensor platforms , 1999, Defense, Security, and Sensing.

[4]  Enrico Magli,et al.  Energy consumption and image quality in wireless video-surveillance networks , 2002, The 13th IEEE International Symposium on Personal, Indoor and Mobile Radio Communications.

[5]  W. Eric L. Grimson,et al.  Using adaptive tracking to classify and monitor activities in a site , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[6]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[7]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[8]  Louise A. Dennis,et al.  System Description: Embedding Verification into Microsoft Excel , 2000, CADE.

[9]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  J. Crowley,et al.  Multi-Modal Tracking of Interacting Targets Using Gaussian Approximations , 2001 .

[11]  James W. Davis,et al.  Real-time closed-world tracking , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Takeo Kanade,et al.  A System for Video Surveillance and Monitoring , 2000 .