Auction-based Federated Learning using Software-defined Networking for resource efficiency

The training of global models using federated learning (FL) strategies is complicated by variations in local model quality arising from variation in data distribution across individual clients. A wide range of training strategies could be created by varying the size and distribution of the training data and the number of training iterations to be performed. All these variables affect both model quality and resource consumption. To facilitate the selection of good training strategies, we propose an auction-based FL method that can identify a training strategy that is optimal in terms of resource management efficiency subject to a given model quality requirement. An auction method is used to dynamically select resource-efficient FL clients and local models to minimize resource usage. This is enabled by using Software-defined Networking (SDN) to support the dynamic management of FL clients. We show that resource-optimal FL strategies can be implemented in the cloud/edge services market; dynamic quality-based model selection can reduce resource costs by up to 17% from the FL server's perspective. Moreover, the client utility function presented herein helps FL clients adopt practical trading strategies to cooperate efficiently with FL servers.

[1]  Dong In Kim,et al.  Toward an Automated Auction Framework for Wireless Federated Learning Services Market , 2019, ArXiv.

[2]  Gyu Myoung Lee,et al.  Competitive Data Trading Model With Privacy Valuation for Multiple Stakeholders in IoT Data Markets , 2020, IEEE Internet of Things Journal.

[3]  Dusit Niyato,et al.  Auction-Based Time Scheduling for Backscatter-Aided RF-Powered Cognitive Radio Networks , 2019, IEEE Transactions on Wireless Communications.

[4]  Yue Zhao,et al.  Federated Learning with Non-IID Data , 2018, ArXiv.

[5]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[6]  Pedro M. Domingos.  A few useful things to know about machine learning , 2012, Commun. ACM.

[7]  Zhu Han,et al.  Market model and optimal pricing scheme of big data and Internet of Things (IoT) , 2016, 2016 IEEE International Conference on Communications (ICC).

[8]  Yang Liu,et al.  A Sustainable Incentive Scheme for Federated Learning , 2020, IEEE Intelligent Systems.

[9]  Ying-Chang Liang,et al.  Incentive Design for Efficient Federated Learning in Mobile Networks: A Contract Theory Approach , 2019, 2019 IEEE VTS Asia Pacific Wireless Communications Symposium (APWCS).

[10]  Xiaowen Chu,et al.  FMore: An Incentive Scheme of Multi-dimensional Auction for Federated Learning in MEC , 2020, ArXiv.

[11]  W. E. Armstrong.  The Determinateness of the Utility Function , 1939 .

[12]  Joohyung Lee,et al.  Three Hierarchical Levels of Big-Data Market Model Over Multiple Data Sources for Internet of Things , 2018, IEEE Access.

[13]  Zhu Han,et al.  Auction based Incentive Design for Efficient Federated Learning in Cellular Wireless Networks , 2020, 2020 IEEE Wireless Communications and Networking Conference (WCNC).

[14]  K. B. Letaief,et al.  A Survey on Mobile Edge Computing: The Communication Perspective , 2017, IEEE Communications Surveys & Tutorials.