Hierarchical Incentive Mechanism Design for Federated Machine Learning in Mobile Networks

In recent years, the enhanced sensing and computation capabilities of Internet-of-Things (IoT) devices have opened the doors to several mobile crowdsensing applications. In mobile crowdsensing, a model owner announces a sensing task following which interested workers collect the required data. However, in some cases, a model owner may have insufficient data samples to build an effective machine learning model. To this end, we propose a federated learning (FL)-based privacy-preserving approach to facilitate collaborative machine learning among multiple model owners in mobile crowdsensing. Our system model allows collaborative machine learning without compromising data privacy given that only the model parameters instead of the raw data are exchanged within the federation. However, there are two main challenges of incentive mismatches between workers and model owners, as well as among model owners. For the former, we leverage on the self-revealing mechanism in the contract theory under information asymmetry. For the latter, to ensure the stability of a federation through preventing free-riding attacks, we use the coalitional game theory approach that rewards model owners based on their marginal contributions. Considering the inherent hierarchical structure of the involved entities, we propose a hierarchical incentive mechanism framework. Using the backward induction, we first solve the contract formulation and then proceed to solve the coalitional game with the merge and split algorithm. The numerical results validate the performance efficiency of our proposed hierarchical incentive mechanism design, in terms of incentive compatibility of our contract design and fair payoffs of model owners in stable federation formation.

[1]  Atsuto Maki,et al.  A systematic study of the class imbalance problem in convolutional neural networks , 2017, Neural Networks.

[2]  Yang Zhang,et al.  A Stackelberg Game Approach for Sponsored Content Management in Mobile Data Market With Network Effects , 2020, IEEE Internet of Things Journal.

[3]  Walid Saad,et al.  Contract-Based Incentive Mechanisms for Device-to-Device Communications in Cellular Networks , 2015, IEEE Journal on Selected Areas in Communications.

[4]  Chen Huang,et al.  Learning Deep Representation for Imbalanced Classification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Francien Dechesne,et al.  EU Personal Data Protection in Policy and Practice , 2019, Information Technology and Law Series.

[6]  Jian Lin,et al.  QUAC: Quality-Aware Contract-Based Incentive Mechanisms for Crowdsensing , 2017, 2017 IEEE 14th International Conference on Mobile Ad Hoc and Sensor Systems (MASS).

[7]  Peter Richtárik,et al.  Federated Optimization: Distributed Machine Learning for On-Device Intelligence , 2016, ArXiv.

[8]  R. Raskar,et al.  R EDUCING LEAKAGE IN DISTRIBUTED DEEP LEARNING FOR SENSITIVE HEALTH DATA , 2019 .

[9]  Zhu Han,et al.  Coalitional game theory for communication networks , 2009, IEEE Signal Processing Magazine.

[10]  Fan Wu,et al.  Sustainable Incentives for Mobile Crowdsensing: Auctions, Lotteries, and Trust and Reputation Systems , 2017, IEEE Communications Magazine.

[11]  Wei Shi,et al.  Federated learning of predictive models from federated Electronic Health Records , 2018, Int. J. Medical Informatics.

[12]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[13]  Ying-Chang Liang,et al.  Joint Service Pricing and Cooperative Relay Communication for Federated Learning , 2018, 2019 International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData).

[14]  Zhi Ding,et al.  Federated Learning via Over-the-Air Computation , 2018, IEEE Transactions on Wireless Communications.

[15]  Mohsen Guizani,et al.  Reliable Federated Learning for Mobile Networks , 2019, IEEE Wireless Communications.

[16]  Stephen P. Boyd,et al.  CVXPY: A Python-Embedded Modeling Language for Convex Optimization , 2016, J. Mach. Learn. Res..

[17]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[18]  Bin Guo,et al.  From participatory sensing to Mobile Crowd Sensing , 2014, 2014 IEEE International Conference on Pervasive Computing and Communication Workshops (PERCOM WORKSHOPS).

[19]  Ying-Chang Liang,et al.  Federated Learning in Mobile Edge Networks: A Comprehensive Survey , 2020, IEEE Communications Surveys & Tutorials.

[20]  Kaoru Ota,et al.  An incentive game based evolutionary model for crowd sensing networks , 2016, Peer-to-Peer Netw. Appl..

[21]  Manfred Reichert,et al.  Mobile Crowd Sensing in Clinical and Psychological Trials -- A Case Study , 2015, 2015 IEEE 28th International Symposium on Computer-Based Medical Systems.

[22]  Robert Steele,et al.  Incentivization for Health Crowdsensing , 2017, 2017 IEEE 15th Intl Conf on Dependable, Autonomic and Secure Computing, 15th Intl Conf on Pervasive Intelligence and Computing, 3rd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech).

[23]  Zhou Su,et al.  Contract Theory Based Incentive Scheme for Mobile Crowd Sensing Networks , 2018, 2018 International Conference on Selected Topics in Mobile and Wireless Networking (MoWNeT).

[24]  R. Srikant,et al.  A game theory based reputation mechanism to incentivize cooperation in wireless ad hoc networks , 2010, Ad Hoc Networks.

[25]  Wei Li,et al.  Distributed Auctions for Task Assignment and Scheduling in Mobile Crowdsensing Systems , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[26]  Shuai Ma,et al.  Improving Data Quality: Consistency and Accuracy , 2007, VLDB.

[27]  Zhu Han,et al.  A Contract-Theoretic Approach to Spectrum Resource Allocation in Wireless Virtualization , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[28]  Jun Luo,et al.  A Stackelberg Game Approach Toward Socially-Aware Incentive Mechanisms for Mobile Crowdsensing , 2018, IEEE Transactions on Wireless Communications.

[29]  Sujit Gujar,et al.  Privacy Preserving and Cost Optimal Mobile Crowdsensing Using Smart Contracts on Blockchain , 2018, 2018 IEEE 15th International Conference on Mobile Ad Hoc and Sensor Systems (MASS).

[30]  Fan Ye,et al.  Mobile crowdsensing: current state and future challenges , 2011, IEEE Communications Magazine.

[31]  Parinaz Naghizadeh Ardabili,et al.  A reputation-based contract for repeated crowdsensing with costly verification , 2017, 2017 American Control Conference (ACC).

[32]  Xue-wen Chen,et al.  Big Data Deep Learning: Challenges and Perspectives , 2014, IEEE Access.

[33]  Albert Y. Zomaya,et al.  Federated Learning over Wireless Networks: Optimization Model Design and Analysis , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[34]  Coalitional Game Theory for Communication Networks: A Tutorial , 2020 .

[35]  Krzysztof R. Apt,et al.  Stable partitions in coalitional games , 2006, ArXiv.

[36]  Ying-Chang Liang,et al.  Incentive Design for Efficient Federated Learning in Mobile Networks: A Contract Theory Approach , 2019, 2019 IEEE VTS Asia Pacific Wireless Communications Symposium (APWCS).

[37]  Yang Liu,et al.  Boosting Privately: Privacy-Preserving Federated Extreme Boosting for Mobile Crowdsensing , 2019, ArXiv.

[38]  Jing Wang,et al.  Quality-Aware and Fine-Grained Incentive Mechanisms for Mobile Crowdsensing , 2016, 2016 IEEE 36th International Conference on Distributed Computing Systems (ICDCS).

[39]  Are Hjørungnes,et al.  Coalition Formation Games for Bandwidth Sharing in Vehicle-To-Roadside Communications , 2010, 2010 IEEE Wireless Communication and Networking Conference.

[40]  Dusit Niyato,et al.  Cloud/Edge Computing Service Management in Blockchain Networks: Multi-Leader Multi-Follower Game-Based ADMM for Pricing , 2020, IEEE Transactions on Services Computing.

[41]  Andrew Raij,et al.  A Survey of Incentive Techniques for Mobile Crowd Sensing , 2015, IEEE Internet of Things Journal.

[42]  Zhu Han,et al.  Coalitional Games for Distributed Collaborative Spectrum Sensing in Cognitive Radio Networks , 2009, IEEE INFOCOM 2009.

[43]  Qiang Liu,et al.  An Edge Network Orchestrator for Mobile Augmented Reality , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[44]  Mehdi Bennis,et al.  On-Device Federated Learning via Blockchain and its Latency Analysis , 2018, ArXiv.

[45]  Dong In Kim,et al.  Efficient Training Management for Mobile Crowd-Machine Learning: A Deep Reinforcement Learning Approach , 2018, IEEE Wireless Communications Letters.

[46]  Takayuki Nishio,et al.  Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge , 2018, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[47]  Zhu Han,et al.  Contract Theory for Wireless Networks , 2017, Wireless Networks.

[48]  Yongdong Wu,et al.  Incentive Mechanism Design for Heterogeneous Peer-to-Peer Networks: A Stackelberg Game Approach , 2014, IEEE Transactions on Mobile Computing.

[49]  Refik Molva,et al.  Core: a collaborative reputation mechanism to enforce node cooperation in mobile ad hoc networks , 2002, Communications and Multimedia Security.

[50]  Jun Luo,et al.  A Socially-Aware Incentive Mechanism for Mobile Crowdsensing Service Market , 2017, 2018 IEEE Global Communications Conference (GLOBECOM).

[51]  Zhu Han,et al.  A Distributed Merge and Split Algorithm for Fair Cooperation in Wireless Networks , 2008, ICC Workshops - 2008 IEEE International Conference on Communications Workshops.

[52]  Xinbing Wang,et al.  Spectrum Trading in Cognitive Radio Networks: A Contract-Theoretic Modeling Approach , 2011, IEEE Journal on Selected Areas in Communications.

[53]  Wei Chen,et al.  The Roadmap to 6G: AI Empowered Wireless Networks , 2019, IEEE Communications Magazine.

[54]  Zhu Han,et al.  Joint Sponsored and Edge Caching Content Service Market: A Game-Theoretic Approach , 2019, IEEE Transactions on Wireless Communications.

[55]  Mohsen Guizani,et al.  An Incentive Mechanism Design for Socially Aware Crowdsensing Services with Incomplete Information , 2019, IEEE Communications Magazine.

[56]  Yunhao Liu,et al.  Incentives for Mobile Crowd Sensing: A Survey , 2016, IEEE Communications Surveys & Tutorials.

[57]  Deze Zeng,et al.  A Learning-Based Incentive Mechanism for Federated Learning , 2020, IEEE Internet of Things Journal.