Reliable Federated Learning for Mobile Networks

Federated learning, as a promising machine learning approach, has emerged to leverage a distributed personalized dataset from a number of nodes, for example, mobile devices, to improve performance while simultaneously providing privacy preservation for mobile users. In federated learning, training data is widely distributed and maintained on the mobile devices as workers. A central aggregator updates a global model by collecting local updates from mobile devices using their local training data to train the global model in each iteration. However, unreliable data may be uploaded by the mobile devices (i.e., workers), leading to frauds in tasks of federated learning. The workers may perform unreliable updates intentionally, for example, the data poisoning attack, or unintentionally, for example, low-quality data caused by energy constraints or high-speed mobility. Therefore, finding out trusted and reliable workers in federated learning tasks becomes critical. In this article, the concept of reputation is introduced as a metric. Based on this metric, a reliable worker selection scheme is proposed for federated learning tasks. Consortium blockchain is leveraged as a decentralized approach for achieving efficient reputation management of the workers without repudiation and tampering. By numerical analysis, the proposed approach is demonstrated to improve the reliability of federated learning tasks in mobile networks.

[1]  Dong In Kim,et al.  Toward Secure Blockchain-Enabled Internet of Vehicles: Optimizing Consensus Management Using Reputation and Contract Theory , 2018, IEEE Transactions on Vehicular Technology.

[2]  He Yang,et al.  Crowdsensing Quality Control and Grading Evaluation Based on a Two-Consensus Blockchain , 2019, IEEE Internet of Things Journal.

[3]  Shengli Xie,et al.  Incentive Mechanism for Reliable Federated Learning: A Joint Optimization Approach to Combining Reputation and Contract Theory , 2019, IEEE Internet of Things Journal.

[4]  Hao Liang,et al.  False Data Injection Attacks Against State Estimation in Multiphase and Unbalanced Smart Distribution Systems , 2019, IEEE Transactions on Smart Grid.

[5]  Geoffrey Ye Li,et al.  Toward Intelligent Vehicular Networks: A Machine Learning Framework , 2018, IEEE Internet of Things Journal.

[6]  Dong In Kim,et al.  Efficient Training Management for Mobile Crowd-Machine Learning: A Deep Reinforcement Learning Approach , 2018, IEEE Wireless Communications Letters.

[7]  Ivan Beschastnikh,et al.  Mitigating Sybils in Federated Learning Poisoning , 2018, ArXiv.

[8]  Yue Zhao,et al.  Federated Learning with Non-IID Data , 2018, ArXiv.

[9]  Donald F. Towsley,et al.  Incentive and reputation mechanisms for online crowdsourcing systems , 2015, 2015 IEEE 23rd International Symposium on Quality of Service (IWQoS).

[10]  Shu Yang,et al.  A survey on application of machine learning for Internet of Things , 2018, International Journal of Machine Learning and Cybernetics.

[11]  Hui Li,et al.  Blockchain-Based Privacy Preserving Deep Learning , 2018, Inscrypt.

[12]  Seong-Lyun Kim,et al.  Blockchained On-Device Federated Learning , 2018, IEEE Communications Letters.

[13]  Ivan Beschastnikh,et al.  Biscotti: A Ledger for Private and Secure Peer-to-Peer Machine Learning , 2018, ArXiv.

[14]  Victor C. M. Leung,et al.  Blockchain-Based Decentralized Trust Management in Vehicular Networks , 2019, IEEE Internet of Things Journal.

[15]  Luca Foschini,et al.  Quantifying User Reputation Scores, Data Trustworthiness, and User Incentives in Mobile Crowd-Sensing , 2017, IEEE Access.