Optimizing Task Assignment for Reliable Blockchain-Empowered Federated Edge Learning

A rapid-growing machine learning technique called federated edge learning has emerged to allow a massive number of edge devices (e.g. smart phones) to collaboratively train globally shared models without revealing their private raw data. This technique not only ensures good machine learning performance but also maintains data privacy of the edge devices. However, the federated edge learning still faces the following critical challenges: (i) difficulty in avoiding unreliable edge devices acting as workers for federated edge learning, and (ii) lack of efficient learning task assignment schemes among task publishers and workers. To tackle these challenges, reputation is utilized as a metric to evaluate the trustworthiness and reliability of the edge devices. A many-to-one matching model is proposed to address the task assignment problem between task publishers and reliable workers with high reputation. For stimulating reliable edge devices to join model training and enable secure reputation management, blockchain is employed to store the training records and manage reputation data in a decentralized and secure manner without the risk of a single point of failure. Numerical results show that the proposed schemes can achieve significant performance improvement in terms of reliability of federated edge learning.

[1]  Dong In Kim,et al.  Toward Secure Blockchain-Enabled Internet of Vehicles: Optimizing Consensus Management Using Reputation and Contract Theory , 2018, IEEE Transactions on Vehicular Technology.

[2]  Minghe Sun,et al.  An optimization approach for existing home seller-buyer matching , 2019, J. Oper. Res. Soc..

[3]  Dusit Niyato,et al.  Training Task Allocation in Federated Edge Learning: A Matching-Theoretic Approach , 2020, 2020 IEEE 17th Annual Consumer Communications & Networking Conference (CCNC).

[4]  Robert W. Irving Stable Marriage and Indifference , 1994, Discret. Appl. Math..

[5]  Yanmei Li,et al.  A Trust Model Based on Subjective Logic , 2009, 2009 Fourth International Conference on Internet Computing for Science and Engineering.

[6]  F. Richard Yu,et al.  MEC-Assisted Immersive VR Video Streaming Over Terahertz Wireless Networks: A Deep Reinforcement Learning Approach , 2020, IEEE Internet of Things Journal.

[7]  Canh Dinh,et al.  Federated Learning Over Wireless Networks: Convergence Analysis and Resource Allocation , 2019, IEEE/ACM Transactions on Networking.

[8]  Zhenghua Chen,et al.  Using Reinforcement Learning to Minimize the Probability of Delay Occurrence in Transportation , 2020, IEEE Transactions on Vehicular Technology.

[9]  Albert Y. Zomaya,et al.  Federated Learning over Wireless Networks: Optimization Model Design and Analysis , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[10]  Zhisheng Niu,et al.  Joint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning , 2020, IEEE Transactions on Wireless Communications.

[11]  Yue Zhang,et al.  DeepChain: Auditable and Privacy-Preserving Deep Learning with Blockchain-Based Incentive , 2019, IEEE Transactions on Dependable and Secure Computing.

[12]  Walid Saad,et al.  Predictive Deployment of UAV Base Stations in Wireless Networks: Machine Learning Meets Contract Theory , 2018, IEEE Transactions on Wireless Communications.

[13]  Qian He,et al.  Blockchain and Deep Reinforcement Learning Empowered Intelligent 5G Beyond , 2019, IEEE Network.

[14]  Shahid Mumtaz,et al.  Computation Resource Allocation and Task Assignment Optimization in Vehicular Fog Computing: A Contract-Matching Approach , 2019, IEEE Transactions on Vehicular Technology.

[15]  Peter Richtárik,et al.  Federated Optimization: Distributed Machine Learning for On-Device Intelligence , 2016, ArXiv.

[16]  Walid Saad,et al.  Distributed Federated Learning for Ultra-Reliable Low-Latency Vehicular Communications , 2018, IEEE Transactions on Communications.

[17]  Shengli Xie,et al.  Incentive Mechanism for Reliable Federated Learning: A Joint Optimization Approach to Combining Reputation and Contract Theory , 2019, IEEE Internet of Things Journal.

[18]  Sameh Sorour,et al.  Task Allocation for Asynchronous Mobile Edge Learning with Delay and Energy Constraints , 2020, ArXiv.

[19]  Yan Zhang,et al.  Deep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networks , 2020, IEEE Transactions on Industrial Informatics.

[20]  Shengli Xie,et al.  NOMA-Enabled Cooperative Computation Offloading for Blockchain-Empowered Internet of Things: A Learning Approach , 2021, IEEE Internet of Things Journal.

[21]  Vitaly Shmatikov,et al.  How To Backdoor Federated Learning , 2018, AISTATS.

[22]  Ivan Beschastnikh,et al.  Biscotti: A Ledger for Private and Secure Peer-to-Peer Machine Learning , 2018, ArXiv.

[23]  Yan Zhang,et al.  Matching game approach for charging scheduling in vehicle-to-grid networks , 2017, 2017 IEEE International Conference on Communications (ICC).

[24]  Seong-Lyun Kim,et al.  Blockchained On-Device Federated Learning , 2018, IEEE Communications Letters.

[25]  Xiaofei Wang,et al.  Networking Integrated Cloud–Edge–End in IoT: A Blockchain-Assisted Collective Q-Learning Approach , 2021, IEEE Internet of Things Journal.

[26]  Ke Zhang,et al.  Deep Reinforcement Learning and Permissioned Blockchain for Content Caching in Vehicular Edge Computing and Networks , 2020, IEEE Transactions on Vehicular Technology.

[27]  La'ercio Lima Pilla,et al.  Optimal Task Assignment to Heterogeneous Federated Learning Devices , 2020, ArXiv.

[28]  Zibin Zheng,et al.  Online Deep Reinforcement Learning for Computation Offloading in Blockchain-Empowered Mobile Edge Computing , 2019, IEEE Transactions on Vehicular Technology.

[29]  Tony Q. S. Quek,et al.  Multi-Armed Bandit-Based Client Scheduling for Federated Learning , 2020, IEEE Transactions on Wireless Communications.

[30]  Ying-Chang Liang,et al.  Federated Learning in Mobile Edge Networks: A Comprehensive Survey , 2020, IEEE Communications Surveys & Tutorials.

[31]  Yong Zhang,et al.  A Novel Reputation Computation Model Based on Subjective Logic for Mobile Ad Hoc Networks , 2009, 2009 Third International Conference on Network and System Security.

[32]  Jiawen Kang,et al.  Privacy-Preserving Traffic Flow Prediction: A Federated Learning Approach , 2020, IEEE Internet of Things Journal.

[33]  Xu Chen,et al.  In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning , 2018, IEEE Network.

[34]  Dusit Niyato,et al.  Federated learning for 6G communications: Challenges, methods, and future directions , 2020, China Communications.

[35]  Zhu Han,et al.  Joint Cache Allocation With Incentive and User Association in Cloud Radio Access Networks Using Hierarchical Game , 2019, IEEE Access.

[36]  Ivan Beschastnikh,et al.  Mitigating Sybils in Federated Learning Poisoning , 2018, ArXiv.

[37]  Xiaoli Chu,et al.  Computation Offloading and Resource Allocation in Vehicular Networks Based on Dual-Side Cost Minimization , 2019, IEEE Transactions on Vehicular Technology.

[38]  H. Zimmermann Fuzzy programming and linear programming with several objective functions , 1978 .

[39]  Gyu Myoung Lee,et al.  Trust Evaluation Mechanism for User Recruitment in Mobile Crowd-Sensing in the Internet of Things , 2019, IEEE Transactions on Information Forensics and Security.

[40]  Minglu Li,et al.  Characterizing Urban Vehicle-to-Vehicle Communications for Reliable Safety Applications , 2020, IEEE Transactions on Intelligent Transportation Systems.

[41]  Xiaofei Wang,et al.  AI-Chain: Blockchain Energized Edge Intelligence for Beyond 5G Networks , 2020, IEEE Network.

[42]  Ke Zhang,et al.  Blockchain Empowered Asynchronous Federated Learning for Secure Data Sharing in Internet of Vehicles , 2020, IEEE Transactions on Vehicular Technology.

[43]  A. Roth The Evolution of the Labor Market for Medical Interns and Residents: A Case Study in Game Theory , 1984, Journal of Political Economy.