Joint Optimization of Data Sampling and User Selection for Federated Learning in the Mobile Edge Computing Systems

Federated learning is a model-level aggregation learning paradigm, which can generate high quality models without collecting the local private data of users. As a distributed coordination learning method, it can be deployed at the edge devices in mobile edge computing (MEC) systems, and provides an applicable solution of implementing network edge intelligence. However, the performance of federated learning cannot be guaranteed in the MEC systems, since the quality of local training data and wireless channels is not always satisfactory. To tackle with this problem, the joint optimization of data sampling and user selection is studied in this paper. First, to capture the key features of deploying federated learning in the MEC systems, we formulate an optimization problem to minimize the accuracy loss and cost, considering the computation and communication resource constraints. Then, an optimization algorithm is designed to jointly optimize the data sampling and user selection strategies, which can approach the stationary optimal solution efficiently. Finally, the numerical simulation and experiment results are provided to evaluate the performance of our proposed optimization scheme, which show that our proposed algorithm can significantly improve the performance of federated learning in the MEC systems.

[1]  Mehdi Bennis,et al.  Toward Interconnected Virtual Reality: Opportunities, Challenges, and Enablers , 2016, IEEE Communications Magazine.

[2]  László Györfi,et al.  A Probabilistic Theory of Pattern Recognition , 1996, Stochastic Modelling and Applied Probability.

[3]  Zhiguo Ding,et al.  On the Design of Computation Offloading in Fog Radio Access Networks , 2019, IEEE Transactions on Vehicular Technology.

[4]  H. Vincent Poor,et al.  Convergence Time Optimization for Federated Learning Over Wireless Networks , 2020, IEEE Transactions on Wireless Communications.

[5]  Ohad Shamir,et al.  Making Gradient Descent Optimal for Strongly Convex Stochastic Optimization , 2011, ICML.

[6]  K. B. Letaief,et al.  A Survey on Mobile Edge Computing: The Communication Perspective , 2017, IEEE Communications Surveys & Tutorials.

[7]  Walid Saad,et al.  A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks , 2021, IEEE Transactions on Wireless Communications.

[8]  Ohad Shamir,et al.  Learnability, Stability and Uniform Convergence , 2010, J. Mach. Learn. Res..

[9]  Roland Vollgraf,et al.  Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms , 2017, ArXiv.

[10]  Ursula Challita,et al.  Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial , 2017, IEEE Communications Surveys & Tutorials.

[11]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.