Federated-Learning-Based Client Scheduling for Low-Latency Wireless Communications

Motivated by the ever-increasing demands for massive data processing and intelligent data analysis at the network edge, federated learning (FL), a distributed architecture for machine learning, has been introduced to enhance edge intelligence without compromising data privacy. Nonetheless, due to the large number of edge devices (referred to as clients in FL) with only limited wireless resources, client scheduling, which chooses only a subset of devices to participate in each round of FL, becomes a more feasible option. Unfortunately, the training latency can be intolerable in the iterative process of FL. To tackle the challenge, this article introduces update-importance-based client scheduling schemes to reduce the required number of rounds. Then latency-based client scheduling schemes are proposed to shorten the time interval for each round. We consider the scenario where no prior information regarding the channel state and the resource usage of the devices is available, and propose a scheme based on the multi-armed bandit theory to strike a balance between exploration and exploitation. Finally, we propose a latency-based technique that exploits update importance to reduce the training time. Computer simulation results are presented to evaluate the convergence rate with respect to the rounds and wall-clock time consumption.

[1]  Tony Q. S. Quek,et al.  Multi-Armed Bandit-Based Client Scheduling for Federated Learning , 2020, IEEE Transactions on Wireless Communications.

[2]  Kin K. Leung,et al.  Energy-Efficient Radio Resource Allocation for Federated Edge Learning , 2019, 2020 IEEE International Conference on Communications Workshops (ICC Workshops).

[3]  Peter Richtárik,et al.  Federated Learning: Strategies for Improving Communication Efficiency , 2016, ArXiv.

[4]  Yue Zhao,et al.  Federated Learning with Non-IID Data , 2018, ArXiv.

[5]  Yan Zhang,et al.  Mobile Edge Computing: A Survey , 2018, IEEE Internet of Things Journal.

[6]  Ke Zhang,et al.  Edge Intelligence and Blockchain Empowered 5G Beyond for the Industrial Internet of Things , 2019, IEEE Network.

[7]  Walid Saad,et al.  A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks , 2021, IEEE Transactions on Wireless Communications.

[8]  Ke Zhang,et al.  Deep Learning Empowered Task Offloading for Mobile Edge Computing in Urban Informatics , 2019, IEEE Internet of Things Journal.

[9]  H. Vincent Poor,et al.  Age-Based Scheduling Policy for Federated Learning in Mobile Edge Networks , 2019, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  Sébastien Bubeck,et al.  Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems , 2012, Found. Trends Mach. Learn..

[11]  Dongning Guo,et al.  Scheduling for Cellular Federated Edge Learning With Importance and Channel Awareness , 2020, IEEE Transactions on Wireless Communications.

[12]  Yi Zhou,et al.  Toward Understanding the Impact of Staleness in Distributed Machine Learning , 2018, ICLR.

[13]  Stefan Wrobel,et al.  Efficient Decentralized Deep Learning by Dynamic Model Averaging , 2018, ECML/PKDD.

[14]  Roy D. Yates,et al.  Real-time status: How often should one update? , 2012, 2012 Proceedings IEEE INFOCOM.

[15]  Anit Kumar Sahu,et al.  Federated Optimization in Heterogeneous Networks , 2018, MLSys.