Energy-Aware Resource Management for Federated Learning in Multi-Access Edge Computing Systems

In Federated Learning (FL), a global statistical model is developed by encouraging mobile users to perform the model training on their local data and aggregating the output local model parameters in an iterative manner. However, due to limited energy and computation capability at the mobile devices, the performance of the model training is always at stake to meet the objective of local energy minimization. In this regard, Multi-access Edge Computing (MEC)-enabled FL addresses the tradeoff between the model performance and the energy consumption of the mobile devices by allowing users to offload a portion of their local dataset to an edge server for the model training. Since the edge server has high computation capability, the time consumption of the model training at the edge server is insignificant. However, the time consumption for dataset offloading from mobile users to the edge server has a significant impact on the total time consumed to complete a single round of FL process. Thus, resource management in MEC-enabled FL is challenging, where the objective is to reduce the total time consumption while saving the energy consumption of the mobile devices. In this article, we formulate an energy-aware resource management for MEC-enabled FL in which the model training loss and the total time consumption are jointly minimized, while considering the energy limitation of mobile devices. In addition, we recast the formulated problem as a Generalized Nash Equilibrium Problem (GNEP) to capture the coupling constraints between the radio resource management and dataset offloading. To that end, we analyze the impact of the dataset offloading and computing resource allocation on the model training loss, time, and the energy consumption. Finally, we present the convergence analysis of the proposed solution, and evaluate its performance against the traditional FL approach. Simulation results demonstrate the efficacy of our proposed solution approach.

[1]  Choong Seon Hong,et al.  A Crowdsourcing Framework for On-Device Federated Learning , 2020, IEEE Transactions on Wireless Communications.

[2]  Mugen Peng,et al.  Joint Optimization of Data Sampling and User Selection for Federated Learning in the Mobile Edge Computing Systems , 2020, 2020 IEEE International Conference on Communications Workshops (ICC Workshops).

[3]  Barbara Panicucci,et al.  Generalized Nash Equilibria for the Service Provisioning Problem in Cloud Systems , 2013, IEEE Transactions on Services Computing.

[4]  Sergio Barbarossa,et al.  Joint Optimization of Radio and Computational Resources for Multicell Mobile-Edge Computing , 2014, IEEE Transactions on Signal and Information Processing over Networks.

[5]  H. Vincent Poor,et al.  Convergence Time Optimization for Federated Learning Over Wireless Networks , 2020, IEEE Transactions on Wireless Communications.

[6]  Richard Nock,et al.  Advances and Open Problems in Federated Learning , 2021, Found. Trends Mach. Learn..

[7]  Walid Saad,et al.  A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks , 2021, IEEE Transactions on Wireless Communications.

[8]  Solmaz Niknam,et al.  Federated Learning for Wireless Communications: Motivation, Opportunities, and Challenges , 2019, IEEE Communications Magazine.

[9]  Mehdi Bennis,et al.  Federated Learning under Channel Uncertainty: Joint Client Scheduling and Resource Allocation , 2020, 2020 IEEE Wireless Communications and Networking Conference (WCNC).

[10]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[11]  Mehdi Bennis,et al.  Hiding in the Crowd: Federated Data Augmentation for On-Device Learning , 2021, IEEE Intelligent Systems.

[12]  Koichi Adachi,et al.  Radio and Computing Resource Allocation for Minimizing Total Processing Completion Time in Mobile Edge Computing , 2019, IEEE Access.

[13]  Walid Saad,et al.  Energy Efficient Federated Learning Over Wireless Communication Networks , 2019, IEEE Transactions on Wireless Communications.

[14]  Jun Zhang,et al.  Stochastic Joint Radio and Computational Resource Management for Multi-User Mobile-Edge Computing Systems , 2017, IEEE Transactions on Wireless Communications.

[15]  Yan Zhang,et al.  Mobile Edge Computing: A Survey , 2018, IEEE Internet of Things Journal.

[16]  Zhu Han,et al.  Generalized Nash Equilibrium Game for Radio and Computing Resource Allocation in Co-located MEC , 2020, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[17]  Albert Y. Zomaya,et al.  Federated Learning over Wireless Networks: Optimization Model Design and Analysis , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[18]  Zdenek Becvar,et al.  Mobile Edge Computing: A Survey on Architecture and Computation Offloading , 2017, IEEE Communications Surveys & Tutorials.

[19]  Ying-Chang Liang,et al.  Federated Learning in Mobile Edge Networks: A Comprehensive Survey , 2020, IEEE Communications Surveys & Tutorials.

[20]  Qiong Wu,et al.  HFEL: Joint Edge Association and Resource Allocation for Cost-Efficient Hierarchical Federated Edge Learning , 2020, IEEE Transactions on Wireless Communications.

[21]  H. Vincent Poor,et al.  Latency and Reliability-Aware Task Offloading and Resource Allocation for Mobile Edge Computing , 2017, 2017 IEEE Globecom Workshops (GC Wkshps).

[22]  Danilo Ardagna,et al.  Generalized Nash Equilibria for the Service Provisioning Problem in Multi-Cloud Systems , 2017, IEEE Transactions on Services Computing.

[23]  Navid Naderializadeh.  On the Communication Latency of Wireless Decentralized Learning , 2020, ArXiv.

[24]  Francisco Facchinei,et al.  Generalized Nash Equilibrium Problems , 2010, Ann. Oper. Res..

[25]  Anit Kumar Sahu,et al.  Federated Learning: Challenges, Methods, and Future Directions , 2019, IEEE Signal Processing Magazine.

[26]  Masahiro Morikura,et al.  Hybrid-FL for Wireless Networks: Cooperative Learning Mechanism Using Non-IID Data , 2019, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[27]  Anja Klein,et al.  A Generalized Nash Game for Mobile Edge Computation Offloading , 2018, 2018 6th IEEE International Conference on Mobile Cloud Computing, Services, and Engineering (MobileCloud).

[28]  Guowang Miao,et al.  Resource Provision for Energy-Efficient Mobile Edge Computing Systems , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[29]  Tarik Taleb,et al.  On Multi-Access Edge Computing: A Survey of the Emerging 5G Network Edge Cloud Architecture and Orchestration , 2017, IEEE Communications Surveys & Tutorials.

[30]  Shuai Zhang,et al.  Generalized Nash Equilibrium Model of the Service Provisioning Problem in Multi-Cloud Competitions , 2018, 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[31]  Choong Seon Hong,et al.  Cost and Latency Tradeoff in Mobile Edge Computing: A Distributed Game Approach , 2019, 2019 IEEE International Conference on Big Data and Smart Computing (BigComp).