Estimation of Individual Device Contributions for Incentivizing Federated Learning

Federated learning (FL) is an emerging technique used to train a machine-learning model collaboratively using the data and computation resource of the mobile devices without exposing privacy-sensitive user data. Appropriate incentive mechanisms that motivate the data and mobile-device owner to participate in FL is key to building a sustainable platform for FL. However, it is difficult to evaluate the contribution level of the devices/owners to determine appropriate rewards without large computation and communication overhead. This paper proposes a computation-and communication-efficient method of estimating a participating device's contribution level. The proposed method enables such estimation during a single FL training process, there by reducing the need for traffic and computation overhead. The performance evaluations using the MNIST dataset show that the proposed method estimates individual participants' contributions accurately with 46-49% less computation overhead and no communication overhead than a naive estimation method.

[1]  Shengli Xie,et al.  Incentive Mechanism for Reliable Federated Learning: A Joint Optimization Approach to Combining Reputation and Contract Theory , 2019, IEEE Internet of Things Journal.

[2]  Dong In Kim,et al.  Toward an Automated Auction Framework for Wireless Federated Learning Services Market , 2019, ArXiv.

[3]  Yang Liu,et al.  Mechanism Design for Multi-Party Machine Learning , 2020, ArXiv.

[4]  Chunyan Miao,et al.  Hierarchical Incentive Mechanism Design for Federated Machine Learning in Mobile Networks , 2020, IEEE Internet of Things Journal.

[5]  Kentaroh Toyoda,et al.  Mechanism Design for An Incentive-aware Blockchain-enabled Federated Learning Platform , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[6]  Deze Zeng,et al.  A Learning-Based Incentive Mechanism for Federated Learning , 2020, IEEE Internet of Things Journal.

[7]  Paul Voigt,et al.  The EU General Data Protection Regulation (GDPR) , 2017 .

[8]  Han Yu,et al.  FedCoin: A Peer-to-Peer Payment System for Federated Learning , 2020, Federated Learning.

[9]  Choong Seon Hong,et al.  A Crowdsourcing Framework for On-Device Federated Learning , 2020, IEEE Transactions on Wireless Communications.

[10]  Amit P. Sheth,et al.  Machine learning for Internet of Things data analysis: A survey , 2017, Digit. Commun. Networks.

[11]  Takayuki Nishio,et al.  Data Assessment and Prioritization in Mobile Networks for Real-Time Prediction of Spatial Information with Machine Learning , 2019, 2019 IEEE First International Workshop on Network Meets Intelligent Computations (NMIC).

[12]  Yang Liu,et al.  A Sustainable Incentive Scheme for Federated Learning , 2020, IEEE Intelligent Systems.

[13]  Ying-Chang Liang,et al.  Incentive Design for Efficient Federated Learning in Mobile Networks: A Contract Theory Approach , 2019, 2019 IEEE VTS Asia Pacific Wireless Communications Symposium (APWCS).

[14]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[15]  Takayuki Nishio,et al.  Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge , 2018, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[16]  Shu Yang,et al.  A survey on application of machine learning for Internet of Things , 2018, International Journal of Machine Learning and Cybernetics.

[17]  Xiaowen Chu,et al.  FMore: An Incentive Scheme of Multi-dimensional Auction for Federated Learning in MEC , 2020, ArXiv.

[18]  Joohyung Lee,et al.  Market Analysis of Distributed Learning Resource Management for Internet of Things: A Game-Theoretic Approach , 2020, IEEE Internet of Things Journal.

[19]  Tianjian Chen,et al.  A Fairness-aware Incentive Scheme for Federated Learning , 2020, AIES.

[20]  Peter Richtárik,et al.  Federated Learning: Strategies for Improving Communication Efficiency , 2016, ArXiv.

[21]  Eiji Oki,et al.  Prioritization of Mobile IoT Data Transmission Based on Data Importance Extracted From Machine Learning Model , 2019, IEEE Access.

[22]  Klaus-Robert Müller,et al.  Robust and Communication-Efficient Federated Learning From Non-i.i.d. Data , 2019, IEEE Transactions on Neural Networks and Learning Systems.