Policy-Based Function-Centric Computation Offloading for Real-Time Drone Video Analytics

Computer vision applications are increasingly used on mobile Internet-of-Things (IoT) devices such as drones. They provide real-time support in disaster/incident response or crowd protest management scenarios by e.g., counting human/vehicles, or recognizing faces/objects. However, deployment of such applications for real-time video analytics at geo-distributed areas presents new challenges in processing intensive media-rich data to meet users’ Quality of Experience (QoE) expectations, due to limited computing power on the devices. In this paper, we present a novel policy-based decision computation offloading scheme that not only facilitates trade-offs in performance vs. cost, but also aids in offloading decision to either an Edge, Cloud or Function-Centric Computing resource architecture for real-time video analytics. To evaluate our offloading scheme, we decompose an existing computer vision pipeline for object/motion detection and object classification into a chain of container-based micro-service functions that communicate via a RESTful API. We evaluate the performance of our scheme on a realistic geo-distributed edge/core cloud testbed using different policies and computing architectures. Results show how our scheme utilizes state-of-the-art computation offloading techniques to Pareto-optimally trade-off performance (i.e., frames-per-second) vs. cost factors (using Amazon Web Services Lambda pricing) during real-time drone video analytics, and thus fosters effective environmental situational awareness.

[1]  Zhuo Chen,et al.  Bandwidth-Efficient Live Video Analytics for Drones Via Edge Computing , 2018, 2018 IEEE/ACM Symposium on Edge Computing (SEC).

[2]  Paramvir Bahl,et al.  GLIMPSE: Continuous, Real-Time Object Recognition on Mobile Devices , 2016, GetMobile Mob. Comput. Commun..

[3]  Nirwan Ansari,et al.  Latency Aware Drone Base Station Placement in Heterogeneous Networks , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[4]  Akihiro Nakao,et al.  GENI: A federated testbed for innovative network experiments , 2014, Comput. Networks.

[5]  Tarik Taleb,et al.  UAV-Based IoT Platform: A Crowd Surveillance Use Case , 2017, IEEE Communications Magazine.

[6]  Young-Bae Ko,et al.  A Design and Simulation of the Opportunistic Computation Offloading with Learning-Based Prediction for Unmanned Aerial Vehicle (UAV) Clustering Networks † , 2018, Sensors.

[7]  Dmitrii Chemodanov,et al.  On QoE-Oriented Cloud Service Orchestration for Application Providers , 2021, IEEE Transactions on Services Computing.

[8]  Tarik Taleb,et al.  Low-Altitude Unmanned Aerial Vehicles-Based Internet of Things Services: Comprehensive Survey and Future Perspectives , 2016, IEEE Internet of Things Journal.

[9]  Hong Min,et al.  Dynamic Computation Offloading Scheme for Drone-Based Surveillance Systems † , 2018, Sensors.

[10]  Guna Seetharaman,et al.  Incident-Supporting Visual Cloud Computing Utilizing Software-Defined Networking , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Dmitrii Chemodanov,et al.  A Near Optimal Reliable Composition Approach for Geo-Distributed Latency-Sensitive Service Chains , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[12]  Aakanksha Chowdhery,et al.  SkyEyes: adaptive video streaming from UAVs , 2016, HotWireless@MobiCom.

[13]  Giovanni Schembra,et al.  A Fleet of MEC UAVs to Extend a 5G Network Slice for Video Monitoring with Low-Latency Constraints , 2019, J. Sens. Actuator Networks.

[14]  Krishna Chintalapudi,et al.  On the Design of MAC Protocols for Low-Latency Hard Real-Time Discrete Control Applications over 802.15.4 Hardware , 2008, 2008 International Conference on Information Processing in Sensor Networks (ipsn 2008).

[15]  Nirwan Ansari,et al.  EdgeIoT: Mobile Edge Computing for the Internet of Things , 2016, IEEE Communications Magazine.

[16]  Dmitrii Chemodanov,et al.  Energy-Aware Mobile Edge Computing and Routing for Low-Latency Visual Data Processing , 2018, IEEE Transactions on Multimedia.

[17]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).