Signal Processing Optimization for Federated Learning over Multi-User MIMO Uplink Channel

In federated learning, remote mobile devices, which are equipped with local datasets, collaborate through a parameter server (PS) in order to train a machine learning model. An advantage of the federated learning is its effectiveness of preserving the privacy of local raw data. However, it is challenging to meet the demands on latency of exchanging data on wireless multiple access channel (MAC) with limited bandwidth. Over-the-air computation (AirComp) is a potential solution to this problem, which leverages the superposition property of MAC channel. This work addresses the signal processing optimization of both digital federated learning and AirComp schemes under multiuser MIMO uplink system. For either system, a mathematical optimization problem is formulated and tackled by deriving an iterative algorithm. Via numerical results, the mean squared error (MSE) performance of the digital and AirComp schemes is compared.

[1]  John M. Cioffi,et al.  Weighted Sum-Rate Maximization Using Weighted MMSE for MIMO-BC Beamforming Design , 2008, 2009 IEEE International Conference on Communications.

[2]  Jun Li,et al.  Gradient Estimation for Federated Learning over Massive MIMO Communication Systems , 2020, ArXiv.

[3]  Hubert Eichner,et al.  Towards Federated Learning at Scale: System Design , 2019, SysML.

[4]  Soo-Hyun Park,et al.  Multiagent DDPG-Based Deep Learning for Smart Ocean Federated Learning IoT Networks , 2020, IEEE Internet of Things Journal.

[5]  Zhi Ding,et al.  Federated Learning via Over-the-Air Computation , 2018, IEEE Transactions on Wireless Communications.

[6]  Michael Gastpar,et al.  Computation Over Multiple-Access Channels , 2007, IEEE Transactions on Information Theory.

[7]  Shlomo Shamai,et al.  Optimizing Over-the-Air Computation in IRS-Aided C-RAN Systems , 2020, 2020 IEEE 21st International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[8]  Junbeom Kim,et al.  An Efficient Rate-Splitting Multiple Access Scheme for the Downlink of C-RAN Systems , 2019, IEEE Wireless Communications Letters.

[9]  Wei Yu,et al.  Fronthaul Compression and Transmit Beamforming Optimization for Multi-Antenna Uplink C-RAN , 2016, IEEE Transactions on Signal Processing.