STAR-RIS Enabled Heterogeneous Networks: Ubiquitous NOMA Communication and Pervasive Federated Learning

This paper integrates non-orthogonal multiple access (NOMA) and over-the-air federated learning (AirFL) into a unified framework using one simultaneous transmitting and reflecting reconfigurable intelligent surface (STAR-RIS). The STAR-RIS plays an important role in adjusting the decoding order of hybrid users for efficient interference mitigation and omni-directional coverage extension. To capture the impact of non-ideal wireless channels on AirFL, a closed-form expression for the optimality gap (a.k.a. convergence upper bound) between the actual loss and the optimal loss is derived. This analysis reveals that the learning performance is significantly affected by active and passive beamforming schemes as well as wireless noise. Furthermore, when the learning rate diminishes as the training proceeds, the optimality gap is explicitly characterized to converge with a linear rate. To accelerate convergence while satisfying QoS requirements, a mixed-integer non-linear programming (MINLP) problem is formulated by jointly designing the transmit power at users and the configuration mode of STARRIS. Next, a trust region-based successive convex approximation method and a penalty-based semidefinite relaxation approach are proposed to handle the decoupled non-convex subproblems iteratively. An alternating optimization algorithm is then developed to find a suboptimal solution for the original MINLP problem. Extensive simulation results show that i) the proposed framework can efficiently support NOMA and AirFL users via concurrent uplink communications, ii) our algorithms can achieve a faster convergence rate on IID and non-IID settings as compared to existing baselines, and iii) both the spectrum efficiency and learning performance can be significantly improved with the aid of the well-tuned STAR-RIS.

[1]  Anit Kumar Sahu,et al.  Federated Learning: Challenges, Methods, and Future Directions , 2019, IEEE Signal Processing Magazine.

[2]  Zeyuan Allen-Zhu,et al.  Natasha 2: Faster Non-Convex Optimization Than SGD , 2017, NeurIPS.

[3]  Zhiguo Ding,et al.  Application of NOMA in 6G Networks: Future Vision and Research Opportunities for Next Generation Multiple Access , 2021, ArXiv.

[4]  Xiang Li,et al.  On the Convergence of FedAvg on Non-IID Data , 2019, ICLR.

[5]  Zhicong Zhong,et al.  P-FedAvg: Parallelizing Federated Learning with Theoretical Guarantees , 2021, IEEE INFOCOM 2021 - IEEE Conference on Computer Communications.

[6]  Hui Tian,et al.  Federated Learning in Multi-RIS-Aided Systems , 2020, IEEE Internet of Things Journal.

[7]  Walid Saad,et al.  A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems , 2019, IEEE Network.

[8]  Michael Gastpar,et al.  Computation Over Multiple-Access Channels , 2007, IEEE Transactions on Information Theory.

[9]  Shree Krishna Sharma,et al.  Efficient Federated Learning Algorithm for Resource Allocation in Wireless IoT Networks , 2021, IEEE Internet of Things Journal.

[10]  Pingzhi Fan,et al.  6G Wireless Networks: Vision, Requirements, Architecture, and Key Technologies , 2019, IEEE Vehicular Technology Magazine.

[11]  Lajos Hanzo,et al.  Nonorthogonal Multiple Access for 5G and Beyond , 2017, Proceedings of the IEEE.

[12]  Alessio Zappone,et al.  Holographic MIMO Surfaces for 6G Wireless Networks: Opportunities, Challenges, and Trends , 2020, IEEE Wireless Communications.

[13]  Jiaru Lin,et al.  Simultaneously Transmitting And Reflecting (STAR) RIS Aided Wireless Communications , 2021, IEEE Transactions on Wireless Communications.

[14]  Mehdi Bennis,et al.  Wireless Network Intelligence at the Edge , 2018, Proceedings of the IEEE.

[15]  Kin K. Leung,et al.  Adaptive Federated Learning in Resource Constrained Edge Computing Systems , 2018, IEEE Journal on Selected Areas in Communications.

[16]  H. Vincent Poor,et al.  RIS Enhanced Massive Non-Orthogonal Multiple Access Networks: Deployment and Passive Beamforming Design , 2020, IEEE Journal on Selected Areas in Communications.

[17]  Mohamed-Slim Alouini,et al.  Smart Radio Environments Empowered by Reconfigurable Intelligent Surfaces: How it Works, State of Research, and Road Ahead , 2020, ArXiv.

[18]  Deniz Gündüz,et al.  Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air , 2019, 2019 IEEE International Symposium on Information Theory (ISIT).

[19]  STAR: Simultaneous Transmission and Reflection for 360° Coverage by Intelligent Surfaces , 2021, IEEE Wireless Communications.

[20]  Walid Saad,et al.  Energy Efficient Federated Learning Over Wireless Communication Networks , 2019, IEEE Transactions on Wireless Communications.

[21]  Kaibin Huang,et al.  Broadband Analog Aggregation for Low-Latency Federated Edge Learning , 2018, IEEE Transactions on Wireless Communications.

[22]  Deniz Gündüz,et al.  One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning: Design and Convergence Analysis , 2020, IEEE Transactions on Wireless Communications.

[23]  Vincent K. N. Lau,et al.  Analog Gradient Aggregation for Federated Learning Over Wireless Networks: Customized Design and Convergence Analysis , 2021, IEEE Internet of Things Journal.

[24]  Rui Zhang,et al.  Towards Smart and Reconfigurable Environment: Intelligent Reflecting Surface Aided Wireless Network , 2019, IEEE Communications Magazine.

[25]  Caijun Zhong,et al.  Integrated Sensing, Computation and Communication in B5G Cellular Internet of Things , 2020, IEEE Transactions on Wireless Communications.

[26]  Shuguang Cui,et al.  Optimized Power Control for Over-the-Air Federated Edge Learning , 2020, ICC 2021 - IEEE International Conference on Communications.

[27]  Jun Zhang,et al.  Communication-Efficient Edge AI: Algorithms and Systems , 2020, IEEE Communications Surveys & Tutorials.

[28]  Walid Saad,et al.  Wireless Communications for Collaborative Federated Learning , 2020, IEEE Communications Magazine.

[29]  Walid Saad,et al.  A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks , 2021, IEEE Transactions on Wireless Communications.

[30]  H. Vincent Poor,et al.  Convergence Time Optimization for Federated Learning Over Wireless Networks , 2020, IEEE Transactions on Wireless Communications.

[31]  Hui Tian,et al.  Resource Allocation for Multi-Cell IRS-Aided NOMA Networks , 2020, IEEE Transactions on Wireless Communications.

[32]  Chau Yuen,et al.  Reconfigurable Intelligent Surfaces for Energy Efficiency in Wireless Communication , 2018, IEEE Transactions on Wireless Communications.

[33]  Yuanwei Liu,et al.  Over-the-Air Federated Learning and Non-Orthogonal Multiple Access Unified by Reconfigurable Intelligent Surface , 2021, IEEE INFOCOM 2021 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[34]  Lajos Hanzo,et al.  Multicell MIMO Communications Relying on Intelligent Reflecting Surfaces , 2019, IEEE Transactions on Wireless Communications.

[35]  Dongning Guo,et al.  Scheduling for Cellular Federated Edge Learning With Importance and Channel Awareness , 2020, IEEE Transactions on Wireless Communications.

[36]  Yonina C. Eldar,et al.  Communication-efficient federated learning , 2021, Proceedings of the National Academy of Sciences.

[37]  Hui Tian,et al.  Integrating Over-the-Air Federated Learning and Non-Orthogonal Multiple Access: What Role can RIS Play? , 2021, ArXiv.

[38]  Qingqing Wu,et al.  Intelligent Reflecting Surface Enhanced Wireless Network via Joint Active and Passive Beamforming , 2018, IEEE Transactions on Wireless Communications.

[39]  Shuguang Cui,et al.  Federated Learning for 6G: Applications, Challenges, and Opportunities , 2021, Engineering.

[40]  Deniz Gündüz,et al.  Communicate to Learn at the Edge , 2020, IEEE Communications Magazine.

[41]  Yonina C. Eldar,et al.  Over-the-Air Federated Learning From Heterogeneous Data , 2020, IEEE Transactions on Signal Processing.

[42]  Petar Popovski,et al.  How URLLC Can Benefit From NOMA-Based Retransmissions , 2020, IEEE Transactions on Wireless Communications.

[43]  Zhi Ding,et al.  Federated Learning via Over-the-Air Computation , 2018, IEEE Transactions on Wireless Communications.

[44]  Zhijin Qin,et al.  Reconfigurable Intelligent Surfaces: Principles and Opportunities , 2020, IEEE Communications Surveys and Tutorials.

[45]  Octavia A. Dobre,et al.  STAR-RISs: Simultaneous Transmitting and Reflecting Reconfigurable Intelligent Surfaces , 2021, IEEE Communications Letters.

[46]  Lingyang Song,et al.  Beyond Intelligent Reflecting Surfaces: Reflective-Transmissive Metasurface Aided Communications for Full-Dimensional Coverage Extension , 2020, IEEE Transactions on Vehicular Technology.

[47]  Meixia Tao,et al.  Gradient Statistics Aware Power Control for Over-the-Air Federated Learning , 2020, IEEE Transactions on Wireless Communications.

[48]  Canh Dinh,et al.  Federated Learning Over Wireless Networks: Convergence Analysis and Resource Allocation , 2019, IEEE/ACM Transactions on Networking.

[49]  Zhu Han,et al.  Hybrid Beamforming for Reconfigurable Intelligent Surface based Multi-User Communications: Achievable Rates With Limited Discrete Phase Shifts , 2019, IEEE Journal on Selected Areas in Communications.

[50]  Yong Zhou,et al.  Federated Machine Learning for Intelligent IoT via Reconfigurable Intelligent Surface , 2020, IEEE Network.

[51]  Yonina C. Eldar,et al.  Federated Learning: A signal processing perspective , 2021, IEEE Signal Processing Magazine.

[52]  Octavia A. Dobre,et al.  Coverage Characterization of STAR-RIS Networks: NOMA and OMA , 2021, IEEE Communications Letters.