DeepBrain: Experimental Evaluation of Cloud-Based Computation Offloading and Edge Computing in the Internet-of-Drones for Deep Learning Applications

Unmanned Aerial Vehicles (UAVs) have been very effective in collecting aerial images data for various Internet-of-Things (IoT)/smart cities applications such as search and rescue, surveillance, vehicle detection, counting, intelligent transportation systems, to name a few. However, the real-time processing of collected data on edge in the context of the Internet-of-Drones remains an open challenge because UAVs have limited energy capabilities, while computer vision techniquesconsume excessive energy and require abundant resources. This fact is even more critical when deep learning algorithms, such as convolutional neural networks (CNNs), are used for classification and detection. In this paper, we first propose a system architecture of computation offloading for Internet-connected drones. Then, we conduct a comprehensive experimental study to evaluate the performance in terms of energy, bandwidth, and delay of the cloud computation offloading approach versus the edge computing approach of deep learning applications in the context of UAVs. In particular, we investigate the tradeoff between the communication cost and the computation of the two candidate approaches experimentally. The main results demonstrate that the computation offloading approach allows us to provide much higher throughput (i.e., frames per second) as compared to the edge computing approach, despite the larger communication delays.

[1]  Anis Koubaa,et al.  Unsupervised Domain Adaptation using Generative Adversarial Networks for Semantic Segmentation of Aerial Images , 2019, Remote. Sens..

[2]  Yilong Yin,et al.  Multi-Task Cost-Sensitive-Convolutional Neural Network for Car Detection , 2019, IEEE Access.

[3]  Yiming Miao,et al.  Energy efficient for UAV-enabled mobile edge computing networks: Intelligent task prediction and offloading , 2020, Comput. Commun..

[4]  Abdulhameed Alelaiwi,et al.  An efficient method of computation offloading in an edge cloud platform , 2019, J. Parallel Distributed Comput..

[5]  Shancang Li,et al.  A Heuristic Offloading Method for Deep Learning Edge Services in 5G Networks , 2019, IEEE Access.

[6]  Anis Koubaa,et al.  DroneTrack: Cloud-Based Real-Time Object Tracking Using Unmanned Aerial Vehicles Over the Internet , 2018, IEEE Access.

[7]  Theocharis Theocharides,et al.  Deep-Learning-Based Aerial Image Classification for Emergency Response Applications Using Unmanned Aerial Vehicles , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[8]  Song Guo,et al.  Traffic and Computation Co-Offloading With Reinforcement Learning in Fog Computing for Industrial Applications , 2019, IEEE Transactions on Industrial Informatics.

[9]  João Paulo Papa,et al.  Semi-supervised learning with convolutional neural networks for UAV images automatic recognition , 2019, Comput. Electron. Agric..

[10]  Qi Wang,et al.  An intelligent task offloading algorithm (iTOA) for UAV edge computing network , 2020, Digit. Commun. Networks.

[11]  Anis Koubaa,et al.  Car Detection using Unmanned Aerial Vehicles: Comparison between Faster R-CNN and YOLOv3 , 2018, 2019 1st International Conference on Unmanned Vehicle Systems-Oman (UVS).

[12]  Bin Hu,et al.  When Deep Reinforcement Learning Meets 5G-Enabled Vehicular Networks: A Distributed Offloading Framework for Traffic Big Data , 2020, IEEE Transactions on Industrial Informatics.

[13]  Anis Koubaa,et al.  Towards a Distributed Computation Offloading Architecture for Cloud Robotics , 2019, 2019 15th International Wireless Communications & Mobile Computing Conference (IWCMC).

[14]  Naif Alajlan,et al.  Deep Learning Approach for Car Detection in UAV Imagery , 2017, Remote. Sens..

[15]  Hong-Yuan Mark Liao,et al.  YOLOv4: Optimal Speed and Accuracy of Object Detection , 2020, ArXiv.

[16]  Anis Koubaa Service-Oriented Software Architecture for Cloud Robotics , 2019, ArXiv.

[17]  Hai Lin,et al.  A survey on computation offloading modeling for edge computing , 2020, J. Netw. Comput. Appl..

[18]  Jiong Jin,et al.  Motion and Connectivity Aware Offloading in Cloud Robotics via Genetic Algorithm , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[19]  Rose Qingyang Hu,et al.  Mobility-Aware Edge Caching and Computing in Vehicle Networks: A Deep Reinforcement Learning , 2018, IEEE Transactions on Vehicular Technology.

[20]  Eduardo Tovar,et al.  A service-oriented Cloud-based management system for the Internet-of-Drones , 2017, 2017 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[21]  Feng Lyu,et al.  Space/Aerial-Assisted Computing Offloading for IoT Applications: A Learning-Based Approach , 2019, IEEE Journal on Selected Areas in Communications.

[22]  Anis Koubaa,et al.  Aerial Images Processing for Car Detection using Convolutional Neural Networks: Comparison between Faster R-CNN and YoloV3 , 2019, ArXiv.

[23]  Mostafa Ghobaei-Arani,et al.  A survey on the computation offloading approaches in mobile edge computing: A machine learning-based perspective , 2020, Comput. Networks.

[24]  Sidi-Mohammed Senouci,et al.  UAVs for traffic monitoring: A sequential game-based computation offloading/sharing approach , 2020, Comput. Networks.

[25]  Giancarlo Fortino,et al.  Autonomic computation offloading in mobile edge for IoT applications , 2019, Future Gener. Comput. Syst..

[26]  Anis Koubâa,et al.  Robot Operating System (ROS): The Complete Reference (Volume 1) , 2016 .

[27]  Dan Grigoras,et al.  Multi-service Cloud of Drones for Multi-purpose Applications , 2017, 2017 16th International Symposium on Parallel and Distributed Computing (ISPDC).

[28]  Zhuo Chen,et al.  Bandwidth-Efficient Live Video Analytics for Drones Via Edge Computing , 2018, 2018 IEEE/ACM Symposium on Edge Computing (SEC).

[29]  Hong Min,et al.  Dynamic Computation Offloading Scheme for Drone-Based Surveillance Systems † , 2018, Sensors.

[30]  Eduardo Tovar,et al.  Dronemap Planner: A service-oriented cloud-based management system for the Internet-of-Drones , 2019, Ad Hoc Networks.

[31]  Ivan Kristianto Singgih,et al.  Node and Edge Drone Surveillance Problem With Consideration of Required Observation Quality and Battery Replacement , 2020, IEEE Access.

[32]  Zhaolong Ning,et al.  Mobile Edge Computing-Enabled 5G Vehicular Networks: Toward the Integration of Communication and Computing , 2019, IEEE Vehicular Technology Magazine.

[33]  Soumaya Cherkaoui,et al.  A Game Theory Based Efficient Computation Offloading in an UAV Network , 2019, IEEE Transactions on Vehicular Technology.

[34]  M. Arif Wani,et al.  Advances in Deep Learning , 2020 .

[35]  Anis Koubaa,et al.  ROSLink: Bridging ROS with the Internet-of-Things for Cloud Robotics , 2017 .

[36]  Trevor N. Mudge,et al.  Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge , 2017, ASPLOS.

[37]  Rami Langar,et al.  Collaborative Computation Offloading for Multi-access Edge Computing , 2019, 2019 IFIP/IEEE Symposium on Integrated Network and Service Management (IM).

[38]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[39]  Jingyu Wang,et al.  Knowledge-Driven Service Offloading Decision for Vehicular Edge Computing: A Deep Reinforcement Learning Approach , 2019, IEEE Transactions on Vehicular Technology.

[40]  Zibin Zheng,et al.  QoS-Aware Cooperative Computation Offloading for Robot Swarms in Cloud Robotics , 2019, IEEE Transactions on Vehicular Technology.

[41]  Adeeb Noor,et al.  Agent-enabled task offloading in UAV-aided mobile edge computing , 2020, Comput. Commun..

[42]  Chen-Khong Tham,et al.  A deep reinforcement learning based offloading scheme in ad-hoc mobile clouds , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[43]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[44]  Zhuo Chen,et al.  Edge-Based Live Video Analytics for Drones , 2019, IEEE Internet Computing.

[45]  Michael Seufert,et al.  Dynamic cloud service placement for live video streaming with a remote-controlled drone , 2017, 2017 IFIP/IEEE Symposium on Integrated Network and Service Management (IM).