Analytics-Aware Storage of Surveillance Videos: Implementation and Optimization

Increasingly more surveillance cameras in smart environments stream videos to storage servers for on-demand video analytics queries in the future. Unlike on-demand video services, in which maximizing the user-perceived video quality is the design objective, the considered storage servers aim to retain as much information as possible while offering enough space for incoming video clips. In this paper, we design, optimize, and implement an analytics-aware storage server on a smart campus testbed at NTHU, Taiwan, which consists of eight smart street lamps equipped with various sensors, network devices, analytics servers, and a storage server. We focus on the design and implementation of the storage server, and consider two key research problems: (i) how to efficiently determine the information amount of individual video clips and (ii) how to intelligently downsample individual video clips. More specifically, the first problem is to sample video frames from the stored video clips to analyze for approximations of the information amount without overloading the storage server. The resulting information amount is fed into the second problem to decide the video downsampling approaches for retaining as much information amount as possible without consuming excessive storage space. We propose two efficient algorithms to solve these two problems and compare their performance with the current practices via real experiments on our smart campus testbed. Our experiment results reveal the practicality and efficiency of our proposed design and algorithms, e.g., compared to the current practices, our storage server: (i) improves the per-request information amount by up to ~ 4 times, (ii) increases the total information amount by at most ~ 20%, (iii) boosts the number of saved video clips by up to ~ 35%, (iv) runs in real-time, and (v) scales well with larger storage space.

[1]  Zhongyuan Wang,et al.  Smart Monitoring Cameras Driven Intelligent Processing to Big Surveillance Video Data , 2018, IEEE Transactions on Big Data.

[2]  Daniel A. Rodríguez-Silva,et al.  Video Surveillance Based on Cloud Storage , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[3]  Patrick J. Flynn,et al.  On Low-Resolution Face Recognition in the Wild: Comparisons and New Techniques , 2018, IEEE Transactions on Information Forensics and Security.

[4]  Magdy A. Bayoumi,et al.  High Performance On-demand Video Transcoding Using Cloud Services , 2016, 2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid).

[5]  Caifeng Shan,et al.  Sensors, vision and networks: From video surveillance to activity recognition and health monitoring , 2019, J. Ambient Intell. Smart Environ..

[6]  Soo Young Shin,et al.  An intrusion oriented heuristic for efficient resource management in end-to-end wireless video surveillance systems , 2018, 2018 15th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[7]  Nitesh Funde,et al.  Object Detection and Tracking Approaches for Video Surveillance Over Camera Network , 2019, 2019 5th International Conference on Advanced Computing & Communication Systems (ICACCS).

[8]  Abdul Rauf,et al.  Video Surveillance-Based Intelligent Traffic Management in Smart Cities , 2019, Intelligent Video Surveillance.

[9]  Prateep Misra,et al.  Smart city surveillance: Leveraging benefits of cloud data stores , 2012, 37th Annual IEEE Conference on Local Computer Networks - Workshops.

[10]  M. Shamim Hossain,et al.  Resource Allocation for Service Composition in Cloud-based Video Surveillance Platform , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[11]  Cornelius Held,et al.  Intelligent Video Surveillance , 2012, Computer.

[12]  Paramvir Bahl,et al.  Real-Time Video Analytics: The Killer App for Edge Computing , 2017, Computer.

[13]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Peng Liu,et al.  EdgeEye: An Edge Service Framework for Real-time Intelligent Video Analytics , 2018, EdgeSys@MobiSys.