Prior-Free Auctions for the Demand Side of Federated Learning

Federated learning (FL) is a paradigm that allows distributed clients to learn a shared machine learning model without sharing their sensitive training data. While largely decentralized, FL requires resources to fund a central orchestrator or to reimburse contributors of datasets to incentivize participation. Inspired by insights from prior-free auction design, we propose a mechanism, FIPFA (Federated Incentive Payments via Prior-Free Auctions), to collect monetary contributions from self-interested clients. The mechanism operates in the semi-honest trust model and works even if clients have a heterogeneous interest in receiving high-quality models, and the server does not know the clients’ level of interest. We run experiments on the MNIST dataset to test clients’ model quality under FIPFA and FIPFA’s incentive properties.

[1]  Roland Vollgraf,et al.  Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms , 2017, ArXiv.

[2]  Hubert Eichner,et al.  Towards Federated Learning at Scale: System Design , 2019, SysML.

[3]  Tzu-Ming Harry Hsu,et al.  Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classification , 2019, ArXiv.

[4]  Yang Liu,et al.  Mechanism Design for Multi-Party Machine Learning , 2020, ArXiv.

[5]  E. H. Clarke Multipart pricing of public goods , 1971 .

[6]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[7]  Andrew V. Goldberg,et al.  Competitive Auctions for Multiple Digital Goods , 2001, ESA.

[8]  Donald Beaver,et al.  Foundations of Secure Interactive Computing , 1991, CRYPTO.

[9]  Jason D. Hartline Mechanism Design and Approximation , 2014 .

[10]  Choong Seon Hong,et al.  An Incentive Mechanism for Federated Learning in Wireless Cellular Networks: An Auction Approach , 2020, IEEE Transactions on Wireless Communications.

[11]  Dong In Kim,et al.  Toward an Automated Auction Framework for Wireless Federated Learning Services Market , 2019, ArXiv.

[12]  Tian Li,et al.  Fair Resource Allocation in Federated Learning , 2019, ICLR.

[13]  Yann LeCun,et al.  The mnist database of handwritten digits , 2005 .

[14]  Michal Feldman,et al.  Overcoming free-riding behavior in peer-to-peer systems , 2005, SECO.

[15]  Lalana Kagal,et al.  BlockFLow: An Accountable and Privacy-Preserving Solution for Federated Learning , 2020, ArXiv.

[16]  Burak Kantarci,et al.  Federated Learning in Smart City Sensing: Challenges and Opportunities , 2020, Sensors.