Reconfigurable Intelligent Surface Enabled Federated Learning: A Unified Communication-Learning Design Approach

To exploit massive amounts of data generated at mobile edge networks, federated learning (FL) has been proposed as an attractive substitute for centralized machine learning (ML). By collaboratively training a shared learning model at edge devices, FL avoids direct data transmission and thus overcomes high communication latency and privacy issues as compared to centralized ML. To improve the communication efficiency in FL model aggregation, over-the-air computation has been introduced to support a large number of simultaneous local model uploading by exploiting the inherent superposition property of wireless channels. However, due to the heterogeneity of communication capacities among edge devices, over-the-air FL suffers from the straggler issue in which the device with the weakest channel acts as a bottleneck of the model aggregation performance. This issue can be alleviated by device selection to some extent, but the latter still suffers from a tradeoff between data exploitation and model communication. In this paper, we leverage the reconfigurable intelligent surface (RIS) technology to relieve the straggler issue in over-the-air FL. Specifically, we develop a learning analysis framework to quantitatively characterize the impact of device selection and model aggregation error on the convergence of over-the-air FL. Then, we formulate a unified communication-learning optimization problem to jointly optimize device selection, over-the-air transceiver design, and RIS configuration. Numerical experiments show that the proposed design achieves substantial learning accuracy improvements compared with the state-of-the-art approaches, especially when channel conditions vary dramatically across edge devices.

[1]  Roland Vollgraf,et al.  Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms , 2017, ArXiv.

[2]  Li Chen,et al.  A Uniform-Forcing Transceiver Design for Over-the-Air Function Computation , 2018, IEEE Wireless Communications Letters.

[3]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[4]  Joel Nothman,et al.  SciPy 1.0-Fundamental Algorithms for Scientific Computing in Python , 2019, ArXiv.

[5]  Changsheng You,et al.  Intelligent Reflecting Surface-Aided Wireless Communications: A Tutorial , 2020, IEEE Transactions on Communications.

[6]  Kaibin Huang,et al.  Broadband Analog Aggregation for Low-Latency Federated Edge Learning , 2018, IEEE Transactions on Wireless Communications.

[7]  Peter Rossmanith,et al.  Simulated Annealing , 2008, Taschenbuch der Algorithmen.

[8]  Shuguang Cui,et al.  Channel Estimation for Intelligent Reflecting Surface Assisted Multiuser Communications: Framework, Algorithms, and Analysis , 2019, IEEE Transactions on Wireless Communications.

[9]  Zhi Ding,et al.  Federated Learning via Over-the-Air Computation , 2018, IEEE Transactions on Wireless Communications.

[10]  Kathryn A. Dowsland,et al.  Simulated Annealing , 1989, Encyclopedia of GIS.

[11]  Kaibin Huang,et al.  Towards an Intelligent Edge: Wireless Communication Meets Machine Learning , 2018, ArXiv.

[12]  Xiaojun Yuan,et al.  Matrix-Calibration-Based Cascaded Channel Estimation for Reconfigurable Intelligent Surface Assisted Multiuser MIMO , 2019, IEEE Journal on Selected Areas in Communications.

[13]  Xiaojun Yuan,et al.  Cascaded Channel Estimation for Large Intelligent Metasurface Assisted Massive MIMO , 2019, IEEE Wireless Communications Letters.

[14]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[15]  Abbas Jamalipour,et al.  Wireless communications , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[16]  Deniz Gündüz,et al.  One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning: Design and Convergence Analysis , 2020, IEEE Transactions on Wireless Communications.

[17]  Mark W. Schmidt,et al.  Hybrid Deterministic-Stochastic Methods for Data Fitting , 2011, SIAM J. Sci. Comput..

[18]  Michael Gastpar,et al.  Computation Over Multiple-Access Channels , 2007, IEEE Transactions on Information Theory.

[19]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Walid Saad,et al.  A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks , 2021, IEEE Transactions on Wireless Communications.

[21]  Tao Jiang,et al.  Over-the-Air Computation via Intelligent Reflecting Surfaces , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[22]  Peter Richtárik,et al.  Federated Optimization: Distributed Machine Learning for On-Device Intelligence , 2016, ArXiv.

[23]  Francisco Facchinei,et al.  Decomposition by Partial Linearization: Parallel Optimization of Multi-Agent Systems , 2013, IEEE Transactions on Signal Processing.

[24]  Xiaojun Yuan,et al.  Reconfigurable-Intelligent-Surface Empowered 6G Wireless Communications: Challenges and Opportunities , 2020, ArXiv.

[25]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[26]  Yong Zhou,et al.  Federated Machine Learning for Intelligent IoT via Reconfigurable Intelligent Surface , 2020, IEEE Network.

[27]  Li Chen,et al.  MIMO Over-the-Air Computation: Beamforming Optimization on the Grassmann Manifold , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[28]  Mung Chiang,et al.  Distributed Nonconvex Power Control using Gibbs Sampling , 2012, IEEE Transactions on Communications.

[29]  Qiang Cheng,et al.  Wireless Communications With Reconfigurable Intelligent Surface: Path Loss Modeling and Experimental Measurement , 2019, IEEE Transactions on Wireless Communications.

[30]  Alessio Zappone,et al.  Holographic MIMO Surfaces for 6G Wireless Networks: Opportunities, Challenges, and Trends , 2020, IEEE Wireless Communications.

[31]  Deniz Gündüz,et al.  Federated Learning Over Wireless Fading Channels , 2019, IEEE Transactions on Wireless Communications.

[32]  Deniz Gündüz,et al.  Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air , 2019, 2019 IEEE International Symposium on Information Theory (ISIT).