Edge-Native Intelligence for 6G Communications Driven by Federated Learning: A Survey of Trends and Challenges

The unprecedented surge of data volume in wireless networks empowered with artificial intelligence (AI) opens up new horizons for providing ubiquitous data-driven intelligent services. Traditional cloud-centric machine learning (ML)-based services are implemented by collecting datasets and training models centrally. However, this conventional training technique encompasses two challenges: (i) high communication and energy cost due to increased data communication, (ii) threatened data privacy by allowing untrusted parties to utilise this information. Recently, in light of these limitations, a new emerging technique, coined as federated learning (FL), arose to bring ML to the edge of wireless networks. FL can extract the benefits of data silos by training a global model in a distributed manner, orchestrated by the FL server. FL exploits both decentralised datasets and computing resources of participating clients to develop a generalised ML model without compromising data privacy. In this article, we introduce a comprehensive survey of the fundamentals and enabling technologies of FL. Moreover, an extensive study is presented detailing various applications of FL in wireless networks and highlighting their challenges and limitations. The efficacy of FL is further explored with emerging prospective beyond fifth generation (B5G) and sixth generation (6G) communication systems. The purpose of this survey is to provide an overview of the state-of-the-art of FL applications in key wireless technologies that will serve as a foundation to establish a firm understanding of the topic. Lastly, we offer a road forward for future research directions.

[1]  Tao Sun,et al.  FedGAN: Federated Generative Adversarial Networks for Distributed Data , 2020, ArXiv.

[2]  Stefan Fenz,et al.  Information Security Automation: How Far Can We Go? , 2011, 2011 Sixth International Conference on Availability, Reliability and Security.

[3]  Yoshua Bengio,et al.  Algorithms for Hyper-Parameter Optimization , 2011, NIPS.

[4]  Siddeeq Y. Ameen,et al.  ENHANCED MOBILE BROADBAND (EMBB): A REVIEW , 2021 .

[5]  Jun Zhang,et al.  Edge-Assisted Hierarchical Federated Learning with Non-IID Data , 2019, ArXiv.

[6]  Jinho Choi,et al.  Federated Learning With Blockchain for Autonomous Vehicles: Analysis and Design Challenges , 2020, IEEE Transactions on Communications.

[7]  Mohamed-Slim Alouini,et al.  Performance Analysis of Integrated Satellite-Terrestrial Multiantenna Relay Networks With Multiuser Scheduling , 2020, IEEE Transactions on Aerospace and Electronic Systems.

[8]  Albert Y. Zomaya,et al.  Stochastic Client Selection for Federated Learning With Volatile Clients , 2020, IEEE Internet of Things Journal.

[9]  Mohsen Guizani,et al.  Budgeted Online Selection of Candidate IoT Clients to Participate in Federated Learning , 2020, IEEE Internet of Things Journal.

[10]  Kaibin Huang,et al.  Broadband Analog Aggregation for Low-Latency Federated Edge Learning , 2018, IEEE Transactions on Wireless Communications.

[11]  Alexandre Lacoste,et al.  Quantifying the Carbon Emissions of Machine Learning , 2019, ArXiv.

[12]  George Chryssolouris,et al.  Digital twin-driven supervised machine learning for the development of artificial intelligence applications in manufacturing , 2020, Int. J. Comput. Integr. Manuf..

[13]  Roberto Riggio,et al.  Centralized and Federated Learning for Predictive VNF Autoscaling in Multi-Domain 5G Networks and Beyond , 2021, IEEE Transactions on Network and Service Management.

[14]  Jian Wang,et al.  Technical Introduction of Wireless Mesh Network , 2021, International Journal of Advanced Network, Monitoring and Controls.

[15]  Laura Pierucci,et al.  The quality of experience perspective toward 5G technology , 2015, IEEE Wireless Communications.

[16]  Anatolij Zubow,et al.  The Future is Unlicensed: Coexistence in the Unlicensed Spectrum for 5G , 2018, ArXiv.

[17]  Shengwen Yang,et al.  Parallel Distributed Logistic Regression for Vertical Federated Learning without Third-Party Coordinator , 2019, ArXiv.

[18]  Martin Crane,et al.  AI Cloud-Based Smart Manufacturing and 3D Printing Techniques for Future In-House Production , 2019, 2019 International Conference on Artificial Intelligence and Advanced Manufacturing (AIAM).

[19]  Xiaofei Wang,et al.  Federated Deep Reinforcement Learning for Internet of Things With Decentralized Cooperative Edge Caching , 2020, IEEE Internet of Things Journal.

[20]  Dusit Niyato,et al.  A Secure Federated Learning Framework for 5G Networks , 2020, IEEE Wireless Communications.

[21]  Hao Wang,et al.  Optimizing Federated Learning on Non-IID Data with Reinforcement Learning , 2020, IEEE INFOCOM 2020 - IEEE Conference on Computer Communications.

[22]  Aryan Mokhtari,et al.  Personalized Federated Learning: A Meta-Learning Approach , 2020, ArXiv.

[23]  Yong Zhou,et al.  Federated Machine Learning for Intelligent IoT via Reconfigurable Intelligent Surface , 2020, IEEE Network.

[24]  Shahid Mumtaz,et al.  Survey on the Internet of Vehicles: Network Architectures and Applications , 2020, IEEE Communications Standards Magazine.

[25]  Xin Qin,et al.  FedHealth: A Federated Transfer Learning Framework for Wearable Healthcare , 2019, IEEE Intelligent Systems.

[26]  Haibo Yang,et al.  Achieving Linear Speedup with Partial Worker Participation in Non-IID Federated Learning , 2021, ICLR.

[27]  Ricardo Vilalta,et al.  A Perspective View and Survey of Meta-Learning , 2002, Artificial Intelligence Review.

[28]  Deze Zeng,et al.  A Learning-Based Incentive Mechanism for Federated Learning , 2020, IEEE Internet of Things Journal.

[29]  Mahdi H. Miraz,et al.  A review on Internet of Things (IoT), Internet of Everything (IoE) and Internet of Nano Things (IoNT) , 2015, 2015 Internet Technologies and Applications (ITA).

[30]  Marko Jurmu,et al.  6G White Paper on Edge Intelligence , 2020, ArXiv.

[31]  Qiong Wu,et al.  Personalized Federated Learning for Intelligent IoT Applications: A Cloud-Edge Based Framework , 2020, IEEE Open Journal of the Computer Society.

[32]  Tarik Taleb,et al.  Virtual security as a service for 5G verticals , 2018, 2018 IEEE Wireless Communications and Networking Conference (WCNC).

[33]  Soo-Hyun Park,et al.  Multiagent DDPG-Based Deep Learning for Smart Ocean Federated Learning IoT Networks , 2020, IEEE Internet of Things Journal.

[34]  Yan Zhang,et al.  Differentially Private Asynchronous Federated Learning for Mobile Edge Computing in Urban Informatics , 2020, IEEE Transactions on Industrial Informatics.

[35]  Hongwei Li,et al.  Secure Multi-Party Computation: Theory, practice and applications , 2019, Inf. Sci..

[36]  Walid Saad,et al.  Distributed Federated Learning for Ultra-Reliable Low-Latency Vehicular Communications , 2018, IEEE Transactions on Communications.

[37]  Tianjian Chen,et al.  Federated Machine Learning: Concept and Applications , 2019 .

[38]  M Awais Javed,et al.  5G Security Artifacts (DoS / DDoS and Authentication) , 2019, 2019 International Conference on Communication Technologies (ComTech).

[39]  Hubert Eichner,et al.  Towards Federated Learning at Scale: System Design , 2019, SysML.

[40]  Raghavendra Selvan,et al.  Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Models , 2020, ArXiv.

[41]  L. Bottou.  Stochastic Gradient Learning in Neural Networks , 1991 .

[42]  Qiang Yang,et al.  Cross-domain sentiment classification via spectral feature alignment , 2010, WWW '10.

[43]  Michail Matthaiou,et al.  Toward Massive Connectivity for IoT in Mixed-ADC Distributed Massive MIMO , 2020, IEEE Internet of Things Journal.

[44]  Eytan Modiano,et al.  Optimizing age-of-information in a multi-class queueing system , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[45]  Abderrahim Benslimane,et al.  Learning in the Air: Secure Federated Learning for UAV-Assisted Crowdsensing , 2021, IEEE Transactions on Network Science and Engineering.

[46]  Marian Codreanu,et al.  On the Age of Information in Status Update Systems With Packet Management , 2015, IEEE Transactions on Information Theory.

[47]  M. Shamim Hossain,et al.  Deep Anomaly Detection for Time-Series Data in Industrial IoT: A Communication-Efficient On-Device Federated Learning Approach , 2020, IEEE Internet of Things Journal.

[48]  Xiaojun Yuan,et al.  Reconfigurable Intelligent Surface Enabled Federated Learning: A Unified Communication-Learning Design Approach , 2020, IEEE Transactions on Wireless Communications.

[49]  Marcus Foth,et al.  Urban informatics , 2011, CSCW.

[50]  H. Vincent Poor,et al.  Convergence Time Optimization for Federated Learning Over Wireless Networks , 2020, IEEE Transactions on Wireless Communications.

[51]  Zibin Zheng,et al.  A Blockchain-Based Decentralized Federated Learning Framework with Committee Consensus , 2020, IEEE Network.

[52]  Milind Kulkarni,et al.  Survey of Personalization Techniques for Federated Learning , 2020, 2020 Fourth World Conference on Smart Trends in Systems, Security and Sustainability (WorldS4).

[53]  Lifeng Sun,et al.  Two-Stream Federated Learning: Reduce the Communication Costs , 2018, 2018 IEEE Visual Communications and Image Processing (VCIP).

[54]  Anit Kumar Sahu,et al.  Federated Learning: Challenges, Methods, and Future Directions , 2019, IEEE Signal Processing Magazine.

[55]  Katharina Eggensperger,et al.  Towards an Empirical Foundation for Assessing Bayesian Optimization of Hyperparameters , 2013 .

[56]  Jiafu Wan,et al.  Artificial Intelligence for Cloud-Assisted Smart Factory , 2018, IEEE Access.

[57]  Hong Liang,et al.  Application of BeiDou navigation satellite system in emergency rescue of natural hazards: a case study for field geological survey of Qinghai−Tibet plateau , 2018, Geo spatial Inf. Sci..

[58]  Richard Nock,et al.  Advances and Open Problems in Federated Learning , 2021, Found. Trends Mach. Learn..

[59]  Mehdi Bennis,et al.  Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Data , 2018, ArXiv.

[60]  Vitaly Shmatikov,et al.  Privacy-preserving deep learning , 2015, 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[61]  David Gil,et al.  Internet of Things: A Review of Surveys Based on Context Aware Intelligent Services , 2016, Sensors.

[62]  Zhu Han,et al.  6G Wireless Systems: A Vision, Architectural Elements, and Future Directions , 2020, IEEE Access.

[63]  Yafeng Zhan,et al.  Study on the Satellite Telemetry Data Classification Based on Self-Learning , 2020, IEEE Access.

[64]  Soo-Hyun Park,et al.  Optimal User Selection for High-Performance and Stabilized Energy-Efficient Federated Learning Platforms , 2020 .

[65]  Syed Muhammad Anwar,et al.  A survey on electric vehicle transportation within smart grid system , 2018 .

[66]  Naixue Xiong,et al.  Selecting Hyper-Parameters of Gaussian Process Regression Based on Non-Inertial Particle Swarm Optimization in Internet of Things , 2019, IEEE Access.

[67]  Shouling Ji,et al.  Privacy Leakage of Real-World Vertical Federated Learning , 2020, ArXiv.

[68]  Carsten Bockelmann,et al.  Massive machine-type communications in 5g: physical and MAC-layer solutions , 2016, IEEE Communications Magazine.

[69]  Jeffrey G. Andrews,et al.  Seven ways that HetNets are a cellular paradigm shift , 2013, IEEE Communications Magazine.

[70]  Mohamed-Slim Alouini,et al.  Wireless Communications Through Reconfigurable Intelligent Surfaces , 2019, IEEE Access.

[71]  Solmaz Niknam,et al.  Federated Learning for Wireless Communications: Motivation, Opportunities, and Challenges , 2019, IEEE Communications Magazine.

[72]  Antonio González-Pardo,et al.  New Artificial Intelligence approaches for future UAV Ground Control Stations , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[73]  Qiang Fan,et al.  Federated Learning in Mobile Edge Computing: An Edge-Learning Perspective for Beyond 5G , 2020, ArXiv.

[74]  Hongbo Zhu,et al.  Federated-Learning-Based Client Scheduling for Low-Latency Wireless Communications , 2021, IEEE Wireless Communications.

[75]  Satyabrata Aich,et al.  Protecting Personal Healthcare Record Using Blockchain & Federated Learning Technologies , 2021, 2021 23rd International Conference on Advanced Communication Technology (ICACT).

[76]  Byonghyo Shim,et al.  Ultra-Reliable and Low-Latency Communications in 5G Downlink: Physical Layer Aspects , 2017, IEEE Wireless Communications.

[77]  Deniz Gündüz,et al.  One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning: Design and Convergence Analysis , 2020, IEEE Transactions on Wireless Communications.

[78]  S. Kummer,et al.  Potential applications of unmanned ground and aerial vehicles to mitigate challenges of transport and logistics-related critical success factors in the humanitarian supply chain , 2020 .

[79]  Chi-Wai Chow,et al.  Micro-LED as a Promising Candidate for High-Speed Visible Light Communication , 2020, Applied Sciences.

[80]  Kashif Ahmad,et al.  Particle Swarm Optimized Federated Learning For Industrial IoT and Smart City Services , 2020, GLOBECOM 2020 - 2020 IEEE Global Communications Conference.

[81]  Zhi Ding,et al.  Federated Learning via Over-the-Air Computation , 2018, IEEE Transactions on Wireless Communications.

[82]  He Zhang,et al.  Digital Twin in Industry: State-of-the-Art , 2019, IEEE Transactions on Industrial Informatics.

[83]  Jie Xu,et al.  Federated Learning for Healthcare Informatics , 2019, ArXiv.

[84]  Takayuki Nishio,et al.  Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge , 2018, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[85]  Ahmet M. Elbir,et al.  Federated Learning for Vehicular Networks , 2020, ArXiv.

[86]  Reza M. Parizi,et al.  Federated Learning: A Survey on Enabling Technologies, Protocols, and Applications , 2020, IEEE Access.

[87]  Tarik Taleb,et al.  Federated Machine Learning: Survey, Multi-Level Classification, Desirable Criteria and Future Directions in Communication and Networking Systems , 2021, IEEE Communications Surveys & Tutorials.

[88]  Nassir Navab,et al.  BrainTorrent: A Peer-to-Peer Environment for Decentralized Federated Learning , 2019, ArXiv.

[89]  Nguyen H. Tran,et al.  Federated Learning-Based Cognitive Detection of Jamming Attack in Flying Ad-Hoc Network , 2020, IEEE Access.

[90]  Tuncer Baykas,et al.  Path Loss Exponent and Shadowing Factor Prediction From Satellite Images Using Deep Learning , 2019, IEEE Access.

[91]  Kin K. Leung,et al.  Adaptive Federated Learning in Resource Constrained Edge Computing Systems , 2018, IEEE Journal on Selected Areas in Communications.

[92]  Lajos Hanzo,et al.  Federated Learning Assisted Multi-UAV Networks , 2020, IEEE Transactions on Vehicular Technology.

[93]  Ameet Talwalkar,et al.  Federated Multi-Task Learning , 2017, NIPS.

[94]  Georges Kaddoum,et al.  Underwater Optical Wireless Communication , 2016, IEEE Access.

[95]  Amos Storkey,et al.  Meta-Learning in Neural Networks: A Survey , 2020, IEEE transactions on pattern analysis and machine intelligence.

[96]  Anit Kumar Sahu,et al.  Federated Optimization in Heterogeneous Networks , 2018, MLSys.

[97]  Zhu Han,et al.  Resource Optimized Federated Learning-Enabled Cognitive Internet of Things for Smart Industries , 2020, IEEE Access.

[98]  Ameet Talwalkar,et al.  Random Search and Reproducibility for Neural Architecture Search , 2019, UAI.

[99]  Walid Saad,et al.  Federated Learning in the Sky: Joint Power Allocation and Scheduling with UAV Swarms , 2020, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[100]  Yifan Yang,et al.  Experiments of Federated Learning for COVID-19 Chest X-ray Images , 2020, Advances in Artificial Intelligence and Security.

[101]  Xiang Li,et al.  On the Convergence of FedAvg on Non-IID Data , 2019, ICLR.

[102]  Qiang Yang,et al.  Federated Deep Reinforcement Learning , 2019, 1901.08277.

[103]  Mohsen Guizani,et al.  Reliable Federated Learning for Mobile Networks , 2019, IEEE Wireless Communications.

[104]  Sarvar Patel,et al.  Practical Secure Aggregation for Privacy-Preserving Machine Learning , 2017, IACR Cryptol. ePrint Arch..

[105]  United Nations.  OFFICE FOR THE COORDINATION OF HUMANITARIAN AFFAIRS , 2000 .

[106]  Yu Yuan,et al.  All Reality: Virtual, Augmented, Mixed (X), Mediated (X, Y), and Multimediated Reality , 2018, ArXiv.

[107]  Adlen Ksentini,et al.  On Predicting Service-oriented Network Slices Performances in 5G: A Federated Learning Approach , 2020, 2020 IEEE 45th Conference on Local Computer Networks (LCN).

[108]  Masao Nakagawa,et al.  Fundamental analysis for visible-light communication system using LED lights , 2004, IEEE Transactions on Consumer Electronics.

[109]  Peter Henderson,et al.  Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learning , 2020, ArXiv.

[110]  Kejiang Ye,et al.  FFD: A Federated Learning Based Method for Credit Card Fraud Detection , 2019, BigData.

[111]  Rong-Rong Chen,et al.  Local Averaging Helps: Hierarchical Federated Learning and Convergence Analysis , 2020, ArXiv.

[112]  Paul Voigt,et al.  The EU General Data Protection Regulation (GDPR) , 2017 .

[113]  Shangguang Wang,et al.  An overview of Internet of Vehicles , 2014, China Communications.

[114]  Supeng Leng,et al.  Federated Learning Empowered End-Edge-Cloud Cooperation for 5G HetNet Security , 2021, IEEE Network.

[115]  Xiangyu Zhang,et al.  Channel Pruning for Accelerating Very Deep Neural Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[116]  Nicu Sebe,et al.  Binary Neural Networks: A Survey , 2020, Pattern Recognit..

[117]  Alexander Hoehn,et al.  User studies of a head-mounted display for search and rescue teleoperation of UAVs via satellite link , 2017, 2017 IEEE Aerospace Conference.

[118]  Shuguang Cui,et al.  Artificial Intelligence Aided Next-Generation Networks Relying on UAVs , 2020, IEEE Wireless Communications.

[119]  Siu-Ming Yiu,et al.  Multi-key privacy-preserving deep learning in cloud computing , 2017, Future Gener. Comput. Syst..

[120]  Choong Seon Hong,et al.  Federated Learning Based Mobile Edge Computing for Augmented Reality Applications , 2020, 2020 International Conference on Computing, Networking and Communications (ICNC).

[121]  Aylin Yener,et al.  Sustainable Federated Learning , 2021, ArXiv.

[122]  Raihan Ur Rasool,et al.  Big data for development: applications and techniques , 2016, ArXiv.

[123]  Marwan Krunz,et al.  Dynamic Network Slicing for Scalable Fog Computing Systems With Energy Harvesting , 2018, IEEE Journal on Selected Areas in Communications.

[124]  Roy D. Yates,et al.  Update or wait: How to keep your data fresh , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[125]  Mahesh K. Marina,et al.  Network Slicing in 5G: Survey and Challenges , 2017, IEEE Communications Magazine.

[126]  Toshiyuki Tanaka,et al.  Search and rescue with autonomous flying robots through behavior-based cooperative intelligence , 2018, Journal of International Humanitarian Action.

[127]  Suhas Diggavi,et al.  Qsparse-Local-SGD: Distributed SGD With Quantization, Sparsification, and Local Computations , 2019, IEEE Journal on Selected Areas in Information Theory.

[128]  Haijian Sun,et al.  Adaptive Federated Learning With Gradient Compression in Uplink NOMA , 2020, IEEE Transactions on Vehicular Technology.

[129]  Symeon Chatzinotas,et al.  Federated Learning Meets Contract Theory: Economic-Efficiency Framework for Electric Vehicle Networks , 2020, IEEE Transactions on Mobile Computing.

[130]  Junjuan Xia,et al.  Battery-constrained Federated Edge Learning in UAV-enabled IoT for B5G/6G Networks , 2021, Phys. Commun..

[131]  Annalisa Milella,et al.  Internet of Robotic Things in Smart Domains: Applications and Challenges , 2020, Sensors.

[132]  H. Vincent Poor,et al.  Federated Learning Meets Blockchain in Edge Computing: Opportunities and Challenges , 2021, IEEE Internet of Things Journal.

[133]  Junmo Kim,et al.  A Gift from Knowledge Distillation: Fast Optimization, Network Minimization and Transfer Learning , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[134]  Sinno Jialin Pan,et al.  MetaQuant: Learning to Quantize by Learning to Penetrate Non-differentiable Quantization , 2019, NeurIPS.

[135]  Jianhua Li,et al.  Friend-as-Learner: Socially-Driven Trustworthy and Efficient Wireless Federated Edge Learning , 2023, IEEE Transactions on Mobile Computing.

[136]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[137]  Peter Richtárik,et al.  Federated Learning: Strategies for Improving Communication Efficiency , 2016, ArXiv.

[138]  Bin Han,et al.  The Road Towards 6G: A Comprehensive Survey , 2021, IEEE Open Journal of the Communications Society.

[139]  Mohsen Guizani,et al.  A Survey on Federated Learning: The Journey From Centralized to Distributed On-Site Learning and Beyond , 2021, IEEE Internet of Things Journal.

[140]  Marco Scavuzzo,et al.  Asynchronous Federated Learning for Geospatial Applications , 2018, DMLE/IOTSTREAMING@PKDD/ECML.

[141]  Erik G. Larsson,et al.  Cell-Free Massive MIMO: Uniformly great service for everyone , 2015, 2015 IEEE 16th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[142]  Blaise Agüera y Arcas,et al.  Federated Learning of Deep Networks using Model Averaging , 2016, ArXiv.

[143]  Burak Kantarci,et al.  Federated Learning in Smart City Sensing: Challenges and Opportunities , 2020, Sensors.

[144]  Yue Zhao,et al.  Federated Learning with Non-IID Data , 2018, ArXiv.

[145]  Sadiq Thomas,et al.  Visible Light Communication: A potential 5G and beyond Communication Technology , 2019, 2019 15th International Conference on Electronics, Computer and Computation (ICECCO).

[146]  David Grace,et al.  High-altitude platforms for wireless communications , 2001 .

[147]  Shiva Raj Pokhrel,et al.  A Blockchained Federated Learning Framework for Cognitive Computing in Industry 4.0 Networks , 2021, IEEE Transactions on Industrial Informatics.

[148]  Lajos Hanzo,et al.  Airplane-Aided Integrated Networking for 6G Wireless: Will It Work? , 2019, IEEE Vehicular Technology Magazine.

[149]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[150]  Filip De Turck,et al.  Network Function Virtualization: State-of-the-Art and Research Challenges , 2015, IEEE Communications Surveys & Tutorials.

[151]  Tarik Taleb,et al.  On Multi-Access Edge Computing: A Survey of the Emerging 5G Network Edge Cloud Architecture and Orchestration , 2017, IEEE Communications Surveys & Tutorials.

[152]  Dawei Wang,et al.  Enhanced reconfigurable intelligent surface assisted mmWave communication: A federated learning approach , 2020, China Communications.

[153]  Tianjian Chen,et al.  A Secure Federated Transfer Learning Framework , 2020, IEEE Intelligent Systems.

[154]  Kentaroh Toyoda,et al.  Mechanism Design for An Incentive-aware Blockchain-enabled Federated Learning Platform , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[155]  Alexandros G. Dimakis,et al.  Gradient Coding: Avoiding Stragglers in Distributed Learning , 2017, ICML.

[156]  Dongning Guo,et al.  Scheduling for Cellular Federated Edge Learning With Importance and Channel Awareness , 2020, IEEE Transactions on Wireless Communications.

[157]  Miao Pan,et al.  Federated Learning in Vehicular Edge Computing: A Selective Model Aggregation Approach , 2020, IEEE Access.

[158]  Guanding Yu,et al.  Accelerating DNN Training in Wireless Federated Edge Learning Systems , 2019, IEEE Journal on Selected Areas in Communications.

[159]  Erik G. Larsson,et al.  Fundamentals of massive MIMO , 2016, SPAWC.

[160]  H. Brendan McMahan,et al.  Learning Differentially Private Recurrent Language Models , 2017, ICLR.

[161]  Christopher De Sa,et al.  Data Programming: Creating Large Training Sets, Quickly , 2016, NIPS.

[162]  Yusheng Ji,et al.  Federated Learning for Vehicular Internet of Things: Recent Advances and Open Issues , 2020, IEEE Open Journal of the Computer Society.

[163]  Carole-Jean Wu,et al.  Sustainable AI: Environmental Implications, Challenges and Opportunities , 2021, MLSys.

[164]  Andrew Zisserman,et al.  Perceiver: General Perception with Iterative Attention , 2021, ICML.

[165]  Sofie Pollin,et al.  Coexistence of Terrestrial and Aerial Users in Cellular Networks , 2017, 2017 IEEE Globecom Workshops (GC Wkshps).

[166]  Chien-Chi Kao,et al.  A Comprehensive Study on the Internet of Underwater Things: Applications, Challenges, and Channel Models † , 2017, Sensors.

[167]  Wei Zhou,et al.  Delegated Proof of Stake With Downgrade: A Secure and Efficient Blockchain Consensus Algorithm With Downgrade Mechanism , 2019, IEEE Access.

[168]  H. Vincent Poor,et al.  On Safeguarding Privacy and Security in the Framework of Federated Learning , 2020, IEEE Network.

[169]  Bingsheng He,et al.  A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection , 2019, IEEE Transactions on Knowledge and Data Engineering.

[170]  M. Shamim Hossain,et al.  Deep Federated Q-Learning-Based Network Slicing for Industrial IoT , 2021, IEEE Transactions on Industrial Informatics.

[171]  Shengli Xie,et al.  Incentive Mechanism for Reliable Federated Learning: A Joint Optimization Approach to Combining Reputation and Contract Theory , 2019, IEEE Internet of Things Journal.

[172]  Philip Bachman,et al.  Deep Reinforcement Learning that Matters , 2017, AAAI.

[173]  Adam Prügel-Bennett,et al.  SVM Parameter Optimization using Grid Search and Genetic Algorithm to Improve Classification Performance , 2016 .

[174]  Jun Zhao,et al.  Privacy-Preserving Blockchain-Based Federated Learning for IoT Devices , 2019, IEEE Internet of Things Journal.

[175]  Leslie N. Smith,et al.  Cyclical Learning Rates for Training Neural Networks , 2015, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[176]  Marina Petrova,et al.  Survey of Spectrum Sharing for Inter-Technology Coexistence , 2017, IEEE Communications Surveys & Tutorials.

[177]  Björn E. Ottersten,et al.  Beam Illumination Pattern Design in Satellite Networks: Learning and Optimization for Efficient Beam Hopping , 2020, IEEE Access.

[178]  Chunyan Miao,et al.  Federated Learning in the Sky: Aerial-Ground Air Quality Sensing Framework With UAV Swarms , 2021, IEEE Internet of Things Journal.

[179]  Seong-Lyun Kim,et al.  Blockchained On-Device Federated Learning , 2018, IEEE Communications Letters.

[180]  Geoffrey E. Hinton,et al.  Distilling the Knowledge in a Neural Network , 2015, ArXiv.

[181]  Martin J. Wainwright,et al.  FedSplit: An algorithmic framework for fast federated optimization , 2020, NeurIPS.

[182]  Fangchen Hu,et al.  Visible Light Communication in 6G: Advances, Challenges, and Prospects , 2020, IEEE Vehicular Technology Magazine.

[183]  Pingzhi Fan,et al.  6G Wireless Networks: Vision, Requirements, Architecture, and Key Technologies , 2019, IEEE Vehicular Technology Magazine.

[184]  Dusit Niyato,et al.  Resource Allocation in Mobility-Aware Federated Learning Networks: A Deep Reinforcement Learning Approach , 2019, 2020 IEEE 6th World Forum on Internet of Things (WF-IoT).

[185]  Gaofeng Nie,et al.  Optimal Transmission Control and Learning-Based Trajectory Design for UAV-Assisted Detection and Communication , 2020, 2020 IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications.

[186]  Tarik Taleb,et al.  On Enabling 5G Automotive Systems Using Follow Me Edge-Cloud Concept , 2018, IEEE Transactions on Vehicular Technology.

[187]  Albert Y. Zomaya,et al.  Federated Learning over Wireless Networks: Optimization Model Design and Analysis , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[188]  Qing He,et al.  Optimizing freshness of information: On minimum age link scheduling in wireless systems , 2016, 2016 14th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt).

[189]  Manzil Zaheer,et al.  Adaptive Federated Optimization , 2020, ICLR.

[190]  Bart De Moor,et al.  Hyperparameter Search in Machine Learning , 2015, ArXiv.

[191]  Fredrik Tufvesson,et al.  5G: A Tutorial Overview of Standards, Trials, Challenges, Deployment, and Practice , 2017, IEEE Journal on Selected Areas in Communications.

[192]  S. R. Biradar,et al.  Survey of Smart Healthcare Systems using Internet of Things (IoT) : (Invited Paper) , 2018, 2018 International Conference on Communication, Computing and Internet of Things (IC3IoT).

[193]  Mehdi Bennis,et al.  Wireless Network Intelligence at the Edge , 2018, Proceedings of the IEEE.

[194]  Deniz Gündüz,et al.  Hierarchical Federated Learning ACROSS Heterogeneous Cellular Networks , 2019, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[195]  Xiaojun Yuan,et al.  CSIT-Free Federated Edge Learning via Reconfigurable Intelligent Surface , 2021, ArXiv.

[196]  Walid Saad,et al.  Federated Learning for Ultra-Reliable Low-Latency V2V Communications , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[197]  Flavio Esposito,et al.  A Distributed Consensus Protocol for Sustainable Federated Learning , 2021, 2021 IEEE 7th International Conference on Network Softwarization (NetSoft).

[198]  Peter J. Smith,et al.  Co-located and distributed antenna systems: deployment options for massive multiple-input–multiple-output , 2015 .

[199]  Geoffrey Ye Li,et al.  Reconfigurable Intelligent Surfaces for Wireless Communications: Principles, Challenges, and Opportunities , 2020, IEEE Transactions on Cognitive Communications and Networking.

[200]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[201]  Gürkan Gür,et al.  Expansive networks: Exploiting spectrum sharing for capacity boost and 6G vision , 2020, J. Commun. Networks.

[202]  Dusit Niyato,et al.  Federated learning for 6G communications: Challenges, methods, and future directions , 2020, China Communications.

[203]  Fahad Saleh,et al.  Blockchain Without Waste: Proof-of-Stake , 2020, The Review of Financial Studies.

[204]  William J. Dally,et al.  Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training , 2017, ICLR.

[205]  S. Nakamoto,et al.  Bitcoin: A Peer-to-Peer Electronic Cash System , 2008 .

[206]  Lajos Hanzo,et al.  Cell-Free Massive MIMO: A New Next-Generation Paradigm , 2019, IEEE Access.

[207]  Abolfazl Razi,et al.  A Review of AI-enabled Routing Protocols for UAV Networks: Trends, Challenges, and Future Outlook , 2021, Ad hoc networks.

[208]  Haythem Bany Salameh,et al.  Securing Delay-Sensitive CR-IoT Networking Under Jamming Attacks: Parallel Transmission and Batching Perspective , 2020, IEEE Internet of Things Journal.

[209]  Dave Evans,et al.  How the Next Evolution of the Internet Is Changing Everything , 2011 .

[210]  Thomas Brox,et al.  A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[211]  Abdullatif Albaseer,et al.  Exploiting Unlabeled Data in Smart Cities using Federated Edge Learning , 2020, 2020 International Wireless Communications and Mobile Computing (IWCMC).

[212]  Walid Saad,et al.  Digital-Twin-Enabled 6G: Vision, Architectural Trends, and Future Directions , 2021, ArXiv.

[213]  M. Chowdhury,et al.  Oort: Informed Participant Selection for Scalable Federated Learning , 2020, ArXiv.

[214]  Haomiao Yang,et al.  Efficient and Privacy-Enhanced Federated Learning for Industrial Artificial Intelligence , 2020, IEEE Transactions on Industrial Informatics.

[215]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[216]  Karina Mabell Gomez,et al.  Aerial-terrestrial communications: terrestrial cooperation and energy-efficient transmissions to aerial base stations , 2014, IEEE Transactions on Aerospace and Electronic Systems.

[217]  Matti Latva-aho,et al.  Key drivers and research challenges for 6G ubiquitous wireless intelligence , 2019 .

[218]  Erik G. Larsson,et al.  Cell-Free Massive MIMO Versus Small Cells , 2016, IEEE Transactions on Wireless Communications.

[219]  Giovanna Castellano,et al.  Meta-data: Characterization of Input Features for Meta-learning , 2005, MDAI.

[220]  Ying-Chang Liang,et al.  Federated Learning in Mobile Edge Networks: A Comprehensive Survey , 2020, IEEE Communications Surveys & Tutorials.

[221]  Xin Jin,et al.  Compressing deep neural networks for efficient visual inference , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[222]  Richard Y. Wang,et al.  Data Quality Assessment , 2002 .

[223]  Ying-Chang Liang,et al.  Device Association for RAN Slicing Based on Hybrid Federated Deep Reinforcement Learning , 2020, IEEE Transactions on Vehicular Technology.

[224]  Binhang Yuan,et al.  A Federated Learning Framework for Healthcare IoT devices , 2020, ArXiv.

[225]  Junyi Li,et al.  Visible light communication: opportunities, challenges and the path to market , 2013, IEEE Communications Magazine.

[226]  Mohsin Iftikhar,et al.  Machine Learning Techniques for 5G and Beyond , 2021, IEEE Access.

[227]  H. Brendan McMahan,et al.  Generative Models for Effective ML on Private, Decentralized Datasets , 2019, ICLR.

[228]  David B. Audretsch,et al.  Artificial intelligence and big data in entrepreneurship: a new era has begun , 2019, Small Business Economics.

[229]  Jesus Alonso-Zarate,et al.  5Growth: An End-to-End Service Platform for Automated Deployment and Management of Vertical Services over 5G Networks , 2021, IEEE Communications Magazine.

[230]  Yan Zhang,et al.  Blockchain and Federated Learning for 5G Beyond , 2021, IEEE Network.

[231]  Jian Cheng,et al.  Quantized Convolutional Neural Networks for Mobile Devices , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[232]  Han Yu,et al.  Threats to Federated Learning: A Survey , 2020, ArXiv.

[233]  Yang Liu,et al.  BatchCrypt: Efficient Homomorphic Encryption for Cross-Silo Federated Learning , 2020, USENIX ATC.