VU: video usefulness and its application in large-scale video surveillance systems: an early experience

In the era of smart and connected communities, a video surveillance system, which usually involves tens and thousands of video cameras, has increasingly become a prominent component for the public safety. In the current practice, when the video surveillance system has a failure, the operation and maintenance team usually spends a lot of time to identify and locate the failure, which cannot guarantee real-time in a large-scale video surveillance system. Meanwhile, the video data with a failure wastes amount of storage space in the cloud. The emergence of edge computing is very promising in the preprocessing for source video data at an edge camera, and video surveillance systems are one of the popular applications for edge computing. In this paper, we propose VU, a Video Usefulness model for large-scale video surveillance systems, and explore its application, such as early failure detection and storage saving. The VU model evaluates the usefulness of video data in a real-time fashion and notifies failures to end-users on the fly. This paper has three contributions: (1) a comprehensive video usefulness model has been proposed. To the best of our knowledge, this is the first work aiming to quality the video usefulness in a real application; (2) real-time failure detection algorithms based on edge computing and cloud computing are proposed to efficiently improve the mean time to repair (i.e., MTTR); (3) effective storage and bandwidth saving schemes for large-scale video surveillance systems are proposed and implemented. Results from a university-wide surveillance system consisting of 2,960 cameras show that failures of video data in different domains are accurately detected by VU model. MTTR is largely shortened by the fast detection algorithm in real time. The video data with the worst degree of VU is mostly discarded to reduce overload in the network and save storage space in the cloud.

[1]  K. A. Joshi,et al.  A Survey on Moving Object Detection and Tracking in Video Surveillance System , 2012 .

[2]  Chen-Yu Lee,et al.  A cost-effective and real-time QoE evaluation method for multimedia streaming services , 2015, Telecommun. Syst..

[3]  Chin-Tser Huang,et al.  Poster Abstract: Smart Urban Surveillance Using Fog Computing , 2016, 2016 IEEE/ACM Symposium on Edge Computing (SEC).

[4]  Lida Xu,et al.  The internet of things: a survey , 2014, Information Systems Frontiers.

[5]  B. Yogameena,et al.  Synoptic video based human crowd behavior analysis for forensic video surveillance , 2015, 2015 Eighth International Conference on Advances in Pattern Recognition (ICAPR).

[6]  Noriki Uchida,et al.  Evaluation of a Seamless Surveillance Video Monitoring System Used by High-Speed Network and High-Resolution Omni-directional Cameras , 2012, 2012 15th International Conference on Network-Based Information Systems.

[7]  アインシュタイン,リチャード,ディー,et al.  Video surveillance system , 2010 .

[8]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[9]  Tomi Räty,et al.  Survey on Contemporary Remote Surveillance Systems for Public Safety , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[11]  S. M. García,et al.  2014: , 2020, A Party for Lazarus.

[12]  Abhaykumar Kumbhar,et al.  A Survey on Legacy and Emerging Technologies for Public Safety Communications , 2015, IEEE Communications Surveys & Tutorials.

[13]  QoS-aware service composition for distributed video surveillance , 2012, Multimedia Tools and Applications.

[14]  G. Edmond,et al.  Justicia’s Gaze: Surveillance, Evidence and the Criminal Trial , 2013 .

[15]  Yong-Ju Lee,et al.  Scalable architecture for an automated surveillance system using edge computing , 2017, The Journal of Supercomputing.

[16]  Antonio Iera,et al.  The Internet of Things: A survey , 2010, Comput. Networks.

[17]  Hong Zhong,et al.  Demo Abstract: EVAPS: Edge Video Analysis for Public Safety , 2016, 2016 IEEE/ACM Symposium on Edge Computing (SEC).

[18]  Roger Zimmermann,et al.  Dynamic Urban Surveillance Video Stream Processing Using Fog Computing , 2016, 2016 IEEE Second International Conference on Multimedia Big Data (BigMM).