Adaptive Configuration Selection and Bandwidth Allocation for Edge-Based Video Analytics

Major cities worldwide have millions of cameras deployed for surveillance, business intelligence, traffic control, crime prevention, etc. Real-time analytics on video data demands intensive computation resources and high energy consumption. Traditional cloud-based video analytics relies on large centralized clusters to ingest video streams. With edge computing, we can offload computeintensive analysis tasks to nearby servers, thus mitigating long latency incurred by data transmission via wide area networks. When offloading video frames from the front-end device to an edge server, the application configuration (i.e., frame sampling rate and frame resolution) will impact several metrics, such as energy consumption, analytics accuracy and user-perceived latency. In this paper, we study the configuration selection and bandwidth allocation for multiple video streams, which are connected to the same edge node sharing an upload link. We propose an efficient online algorithm, called JCAB, which jointly optimizes configuration adaption and bandwidth allocation to address a number of key challenges in edge-based video analytics systems, including edge capacity limitation, unknown network variation, intrusive dynamics of video contents. Our algorithm is developed based on Lyapunov optimization and Markov approximation, works online without requiring future information, and achieves a provable performance bound. We also extend the proposed algorithms to the multi-edge scenario in which each user or video stream has an additional choice about which edge server to connect. Extensive evaluation results show that the proposed solutions can effectively balance the analytics accuracy and energy consumption while keeping low system latency in a variety of settings.

[1]  Paramvir Bahl,et al.  Live Video Analytics at Scale with Approximation and Delay-Tolerance , 2017, NSDI.

[2]  Minghua Chen,et al.  Markov Approximation for Combinatorial Network Optimization , 2010, IEEE Transactions on Information Theory.

[3]  Thomas F. La Porta,et al.  Modeling the Resource Requirements of Convolutional Neural Networks on Mobile Devices , 2017, ACM Multimedia.

[4]  Ethan Katz-Bassett,et al.  Mobile Network Performance from User Devices: A Longitudinal, Multidimensional Analysis , 2014, PAM.

[5]  Zhenming Liu,et al.  DeepDecision: A Mobile Deep Learning Framework for Edge Video Analytics , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[6]  Dipankar Raychaudhuri,et al.  Hetero-Edge: Orchestration of Real-time Vision Applications on Heterogeneous Edge Clouds , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[7]  Marco Gruteser,et al.  Edge Assisted Real-time Object Detection for Mobile Augmented Reality , 2019, MobiCom.

[8]  Mahadev Satyanarayanan,et al.  Scalable crowd-sourcing of video from mobile devices , 2013, MobiSys '13.

[9]  Xu Chen,et al.  Follow Me at the Edge: Mobility-Aware Dynamic Service Placement for Mobile Edge Computing , 2018, 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS).

[10]  Jie Wu,et al.  Online Task Assignment for Crowdsensing in Predictable Mobile Social Networks , 2017, IEEE Transactions on Mobile Computing.

[11]  Khaled Ben Letaief,et al.  Mobile Edge Computing: Survey and Research Outlook , 2017, ArXiv.

[12]  Edmund Wong,et al.  Large-scale Measurements of Wireless Network Behavior , 2015, SIGCOMM.

[13]  Zhuzhong Qian,et al.  Joint Configuration Adaptation and Bandwidth Allocation for Edge-based Real-time Video Analytics , 2020, IEEE INFOCOM 2020 - IEEE Conference on Computer Communications.

[14]  Zhuzhong Qian,et al.  Edge-assisted Online On-device Object Detection for Real-time Video Analytics , 2021, IEEE INFOCOM 2021 - IEEE Conference on Computer Communications.

[15]  Mark Ollila,et al.  UMAR: Ubiquitous Mobile Augmented Reality , 2004, MUM '04.

[16]  Qiang Liu,et al.  An Edge Network Orchestrator for Mobile Augmented Reality , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[17]  Fangming Liu,et al.  AppATP: An Energy Conserving Adaptive Mobile-Cloud Transmission Protocol , 2015, IEEE Transactions on Computers.

[18]  Aakanksha Chowdhery,et al.  Server-Driven Video Streaming for Deep Learning Inference , 2020, SIGCOMM.

[19]  Zhi Zhou,et al.  Cost-Aware Edge Resource Probing for Infrastructure-Free Edge Computing: From Optimal Stopping to Layered Learning , 2019, 2019 IEEE Real-Time Systems Symposium (RTSS).

[20]  Jie Wu,et al.  A Utility-Based Optimization Framework for Edge Service Entity Caching , 2019, IEEE Transactions on Parallel and Distributed Systems.

[21]  Thomas F. La Porta,et al.  A Computing Platform for Video Crowdprocessing Using Deep Learning , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[22]  Yufei Wang,et al.  Reducto: On-Camera Filtering for Resource-Efficient Real-Time Video Analytics , 2020, SIGCOMM.

[23]  Jie Xu,et al.  Joint Service Caching and Task Offloading for Mobile Edge Computing in Dense Networks , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[24]  Michael J. Freedman,et al.  Aggregation and Degradation in JetStream: Streaming Analytics in the Wide Area , 2014, NSDI.

[25]  Sheng Zhang,et al.  Provably Efficient Resource Allocation for Edge Service Entities Using Hermes , 2020, IEEE/ACM Transactions on Networking.

[26]  Song Guo,et al.  A Deep Reinforcement Learning Based Offloading Game in Edge Computing , 2020, IEEE Transactions on Computers.

[27]  Sanglu Lu,et al.  Joint Server Assignment and Resource Management for Edge-Based MAR System , 2020, IEEE/ACM Transactions on Networking.

[28]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[29]  Paramvir Bahl,et al.  Focus: Querying Large Video Datasets with Low Latency and Low Cost , 2018, OSDI.

[30]  Chao Xu,et al.  Dedas: Online Task Dispatching and Scheduling with Bandwidth Constraint in Edge Computing , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[31]  Ion Stoica,et al.  Chameleon: scalable adaptation of video analytics , 2018, SIGCOMM.

[32]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[33]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Edward A. Lee,et al.  AWStream: adaptive wide-area streaming analytics , 2018, SIGCOMM.

[35]  Jian Cheng,et al.  Quantized Convolutional Neural Networks for Mobile Devices , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).