A Large Scale Video Surveillance System with Heterogeneous Information Fusion and Visualization for Wide Area Monitoring

Wide area monitoring for community and city can be a very challenging engineering task due to its scale and heterogeneity in sensor, algorithm, and visualization levels. Multi-modal cameras and algorithms have to be fused into compact presentation for a single operator to actively and effectively respond to anomaly events and jeopardy. This paper presents a distributed and scalable video surveillance system, subcontracted by intelligent surveillance components (ISCs) and visualization surveillance components (VSCs) in compliance with functional labors. The ISCs are high-level algorithms applying computer vision for behavioral analysis of human and vehicles. The VSCs constitute a multi-tier subsystem to visualize fused results of messages, key frames, streaming videos and geographic context information. The system helps the operator to focus attention on interested events gathered from distrusted ISCs and presented by VSCs on map and three-dimensional homographic views. Robustness and effectiveness of the system has been demonstrated by a test run of real scenarios deployed in a campus.

[1]  Sheng-Jyh Wang,et al.  A Hierarchical Bayesian Generation Framework for Vacant Parking Space Detection , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Chin-Teng Lin,et al.  A Conditional Entropy-Based Independent Component Analysis for Applications in Human Detection and Tracking , 2010, EURASIP J. Adv. Signal Process..

[3]  Yuan-Kai Wang,et al.  Real-time camera anomaly detection for real-world video surveillance , 2011, 2011 International Conference on Machine Learning and Cybernetics.

[4]  Lisa M. Brown,et al.  IBM smart surveillance system (S3): event based video surveillance system with an open and extensible framework , 2008, Machine Vision and Applications.

[5]  Li Yu,et al.  Systems issues in distributed multi-modal surveillance , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Yael Pritch,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2008 1 Non-Chronological Video , 2022 .

[7]  Ankush Mittal,et al.  Study of Robust and Intelligent Surveillance in Visible and Multi-modal Framework , 2007, Informatica.

[8]  Ming-Hsiu Tsai,et al.  Vehicle Counting without Background Modeling , 2011, MMM.

[9]  Peter Widhalm,et al.  Next-generation 3D visualization for visual surveillance , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[10]  Tomi Räty,et al.  Survey on Contemporary Remote Surveillance Systems for Public Safety , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[11]  Jun-Wei Hsieh,et al.  Segmentation of Human Body Parts Using Deformable Triangulation , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[12]  Yi-Ping Hung,et al.  Multi-Resolution Design for Large-Scale and High-Resolution Monitoring , 2011, IEEE Transactions on Multimedia.

[13]  Frank M. Shipman,et al.  DOTS: support for effective video surveillance , 2007, ACM Multimedia.

[14]  Ying Lin,et al.  A Kind of Active Fortify Method of Moving Object Detection , 2008, 2008 International Symposium on Computer Science and Computational Technology.