Learning and Batch-Processing Based Coded Computation With Mobility Awareness for Networked Airborne Computing

The implementation of many Unmanned Aerial Vehicle (UAV) applications (e.g., fire detection, surveillance, and package delivery) requires extensive computing resources to achieve reliable performance. Existing solutions that offload computation tasks to the ground may suffer from long communication delays. To address this issue, the Networked Airborne Computing (NAC) is a promising technique, which offers advanced onboard airborne computing capabilities by sharing resources among the UAVs via direct flight-to-flight links. However, NAC does not exist yet and enabling it requires overcoming many technical challenges, such as the high UAV mobility, and the uncertain, heterogeneous, and dynamic airspace. This paper addresses these challenges by 1) developing a Dynamic Batch-Processing based Coded Computation (D-BPCC) framework for achieving robust and adaptable cooperative airborne computing, and 2) designing deep reinforcement learning (DRL) based load allocation and UAV mobility control strategies for optimizing the system performance. As the first study to systematically investigate NAC, to the best of our knowledge, we evaluate the proposed methods through designing a NAC simulator and conducting comparative studies with four state-of-the-art distributed computing schemes. The results demonstrate the promising performance of the proposed methods.

[1]  Omar Sami Oubbati,et al.  Multiagent Deep Reinforcement Learning for Wireless-Powered UAV Networks , 2022, IEEE Internet of Things Journal.

[2]  Fanzi Zeng,et al.  Computation Bits Maximization in UAV-Enabled Mobile-Edge Computing System , 2022, IEEE Internet of Things Journal.

[3]  Omar Sami Oubbati,et al.  Dispatch of UAVs for Urban Vehicular Networks: A Deep Reinforcement Learning Approach , 2021, IEEE Transactions on Vehicular Technology.

[4]  Alexandre Graell i Amat,et al.  Rateless Codes for Low-Latency Distributed Inference in Mobile Edge Computing , 2021, ArXiv.

[5]  Hulya Seferoglu,et al.  Adaptive and Heterogeneity-Aware Coded Cooperative Computation at the Edge , 2021, IEEE Transactions on Mobile Computing.

[6]  Junfei Xie,et al.  Coded Distributed Path Planning for Unmanned Aerial Vehicles , 2021, AIAA AVIATION 2021 FORUM.

[7]  Nickolas M. Wergeles,et al.  A survey and performance evaluation of deep learning methods for small object detection , 2021, Expert Syst. Appl..

[8]  Mohsen Guizani,et al.  Fast, Reliable, and Secure Drone Communication: A Comprehensive Survey , 2021, IEEE Communications Surveys & Tutorials.

[9]  Alia Asheralieva,et al.  Fast and Secure Computational Offloading With Lagrange Coded Mobile Edge Computing , 2021, IEEE Transactions on Vehicular Technology.

[10]  Ekram Hossain,et al.  Multiple Access in Cell-Free Networks: Outage Performance, Dynamic Clustering, and Deep Reinforcement Learning-Based Design , 2021, IEEE Journal on Selected Areas in Communications.

[11]  Baochang Zhang,et al.  Optimization of Task Scheduling and Dynamic Service Strategy for Multi-UAV-Enabled Mobile-Edge Computing System , 2021, IEEE Transactions on Cognitive Communications and Networking.

[12]  Junfei Xie,et al.  Coding for Distributed Multi-Agent Reinforcement Learning , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Kezhi Wang,et al.  Multi-Agent Deep Reinforcement Learning-Based Trajectory Planning for Multi-UAV Assisted Mobile Edge Computing , 2020, IEEE Transactions on Cognitive Communications and Networking.

[14]  Mohammed Atiquzzaman,et al.  UAV assistance paradigm: State-of-the-art in applications and challenges , 2020, J. Netw. Comput. Appl..

[15]  Yong Wang,et al.  Joint Deployment and Task Scheduling Optimization for Large-Scale Mobile Users in Multi-UAV-Enabled Mobile Edge Computing , 2020, IEEE Transactions on Cybernetics.

[16]  Junfei Xie,et al.  Computing in the air: An open airborne computing platform , 2020, IET Commun..

[17]  Ning Zhang,et al.  Air-Ground Integrated Mobile Edge Networks: A Survey , 2020, IEEE Access.

[18]  Carlee Joe-Wong,et al.  Coded Edge Computing , 2020, IEEE INFOCOM 2020 - IEEE Conference on Computer Communications.

[19]  Wei Song,et al.  Task Allocation for Mobile Crowdsensing with Deep Reinforcement Learning , 2020, 2020 IEEE Wireless Communications and Networking Conference (WCNC).

[20]  Lei Lei,et al.  Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing , 2020, IEEE Journal on Selected Areas in Communications.

[21]  Haipeng Yao,et al.  Multi-UAV-Enabled Load-Balance Mobile-Edge Computing for IoT Networks , 2020, IEEE Internet of Things Journal.

[22]  J. Li,et al.  Path Planning for UAV-Mounted Mobile Edge Computing With Deep Reinforcement Learning , 2020, IEEE Transactions on Vehicular Technology.

[23]  Xuemin Shen,et al.  Energy-Efficient UAV-Assisted Mobile Edge Computing: Resource Allocation and Trajectory Optimization , 2020, IEEE Transactions on Vehicular Technology.

[24]  Haifeng Lu,et al.  Optimization of lightweight task offloading strategy for mobile edge computing based on deep reinforcement learning , 2020, Future Gener. Comput. Syst..

[25]  Junfei Xie,et al.  On Batch-Processing Based Coded Computing for Heterogeneous Distributed Computing Systems , 2019, IEEE Transactions on Network Science and Engineering.

[26]  Yan Wan,et al.  Coding for Heterogeneous UAV-Based Networked Airborne Computing , 2019, 2019 IEEE Globecom Workshops (GC Wkshps).

[27]  Junfei Xie,et al.  Toward UAV-Based Airborne Computing , 2019, IEEE Wireless Communications.

[28]  Lei Liu,et al.  Vehicular Edge Computing and Networking: A Survey , 2019, Mobile Networks and Applications.

[29]  Dusit Niyato,et al.  Hierarchical Game-Theoretic and Reinforcement Learning Framework for Computational Offloading in UAV-Enabled Mobile Edge Computing Networks With Multiple Service Providers , 2019, IEEE Internet of Things Journal.

[30]  Yan Chen,et al.  Deep Deterministic Policy Gradient (DDPG)-Based Energy Harvesting Wireless Communications , 2019, IEEE Internet of Things Journal.

[31]  Geoffrey Ye Li,et al.  Joint Offloading and Trajectory Design for UAV-Enabled Mobile Edge Computing Systems , 2019, IEEE Internet of Things Journal.

[32]  Zibin Zheng,et al.  When UAV Swarm Meets Edge-Cloud Computing: The QoS Perspective , 2019, IEEE Network.

[33]  Kezhi Wang,et al.  Energy Efficient Resource Allocation in UAV-Enabled Mobile Edge Computing Networks , 2022 .

[34]  Jiajia Liu,et al.  Task Offloading in UAV-Aided Edge Computing: Bit Allocation and Trajectory Optimization , 2019, IEEE Communications Letters.

[35]  Haijun Wang,et al.  Survey on Unmanned Aerial Vehicle Networks: A Cyber Physical System Perspective , 2018, IEEE Communications Surveys & Tutorials.

[36]  Kai-Kit Wong,et al.  UAV-Assisted Relaying and Edge Computing: Scheduling and Trajectory Optimization , 2018, IEEE Transactions on Wireless Communications.

[37]  Rose Qingyang Hu,et al.  Computation Rate Maximization in UAV-Enabled Wireless-Powered Mobile-Edge Computing Systems , 2018, IEEE Journal on Selected Areas in Communications.

[38]  Tze Meng Low,et al.  A Unified Coded Deep Neural Network Training Strategy based on Generalized PolyDot codes , 2018, 2018 IEEE International Symposium on Information Theory (ISIT).

[39]  Abien Fred Agarap Deep Learning using Rectified Linear Units (ReLU) , 2018, ArXiv.

[40]  Yan Zhang,et al.  Mobile Edge Computing: A Survey , 2018, IEEE Internet of Things Journal.

[41]  Yuxuan Xing,et al.  Dynamic Heterogeneity-Aware Coded Cooperative Computation at the Edge , 2018, 2018 IEEE 26th International Conference on Network Protocols (ICNP).

[42]  Soummya Kar,et al.  Coded Distributed Computing for Inverse Problems , 2017, NIPS.

[43]  Rajkumar Buyya,et al.  mCloud: A Context-Aware Offloading Framework for Heterogeneous Mobile Cloud , 2017, IEEE Transactions on Services Computing.

[44]  Yi Wu,et al.  Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments , 2017, NIPS.

[45]  Pulkit Grover,et al.  Coded convolution for parallel and distributed computing within a deadline , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[46]  Ejaz Ahmed,et al.  Heterogeneity-Aware Task Allocation in Mobile Ad Hoc Cloud , 2017, IEEE Access.

[47]  A. Avestimehr,et al.  Coded computation over heterogeneous clusters , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[48]  Sghaier Guizani,et al.  Mobile ad hoc cloud: A survey , 2016, Wirel. Commun. Mob. Comput..

[49]  Kannan Ramchandran,et al.  Speeding Up Distributed Machine Learning Using Codes , 2015, IEEE Transactions on Information Theory.

[50]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[51]  Mohammad Ali Maddah-Ali,et al.  Coded MapReduce , 2015, 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[52]  Hao Wu,et al.  Heuristics to allocate high-performance cloudlets for computation offloading in mobile ad hoc clouds , 2015, The Journal of Supercomputing.

[53]  J. Wenny Rahayu,et al.  Dynamic Mobile Cloud Computing: Ad Hoc and Opportunistic Job Sharing , 2011, 2011 Fourth IEEE International Conference on Utility and Cloud Computing.

[54]  Karl J. Friston,et al.  Population dynamics: Variance and the sigmoid activation function , 2008, NeuroImage.

[55]  Kenny Q. Ye Indicator function and its application in two-level factorial designs , 2003 .

[56]  Arunselvan Ramaswamy,et al.  Asymptotic Convergence of Deep Multi-Agent Actor-Critic Algorithms , 2022 .

[57]  Baoqian Wang,et al.  Dynamic Coded Convolution with Privacy Awareness for Mobile Ad Hoc Computing , 2022, ArXiv.

[58]  Eduardo F. Morales,et al.  An Introduction to Reinforcement Learning , 2011 .

[59]  Alfred Kobsa,et al.  The Adaptive Web, Methods and Strategies of Web Personalization , 2007, The Adaptive Web.