A Payload Optimization Method for Federated Recommender Systems

In this study, we introduce the payload optimization method for federated recommender systems (FRS). In federated learning (FL), the global model payload that is moved between the server and users depends on the number of items to recommend. The model payload grows when there is an increasing number of items. This becomes challenging for FRS if it is running in production mode. To tackle the payload challenge, we formulated a multi-arm bandit solution that selected part of the global model and transmitted it to all users. The selection process was guided by a novel reward function suitable for FL systems. So far as we are aware, this is the first optimization method that seeks to address item dependent payloads. The method was evaluated using three benchmark recommendation datasets. The empirical validation confirmed that the proposed method outperforms the simpler methods that do not benefit from the bandits for the purpose of item selection. In addition, we have demonstrated the usefulness of our proposed method by rigorously evaluating the effects of a payload reduction on the recommendation performance degradation. Our method achieved up to a 90% reduction in model payload, yielding only a ∼ 4% - 8% loss in the recommendation performance for highly sparse datasets.

[1]  Mehdi Bennis,et al.  Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Data , 2018, ArXiv.

[2]  Zhenguo Li,et al.  Federated Meta-Learning for Recommendation , 2018, ArXiv.

[3]  Kian Hsiang Low,et al.  Federated Bayesian Optimization via Thompson Sampling , 2020, NeurIPS.

[4]  Filip Radlinski,et al.  Learning diverse rankings with multi-armed bandits , 2008, ICML '08.

[5]  Anit Kumar Sahu,et al.  Federated Learning: Challenges, Methods, and Future Directions , 2019, IEEE Signal Processing Magazine.

[6]  Eryk Dutkiewicz,et al.  Energy Demand Prediction with Federated Learning for Electric Vehicle Networks , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[7]  W. R. Thompson ON THE LIKELIHOOD THAT ONE UNKNOWN PROBABILITY EXCEEDS ANOTHER IN VIEW OF THE EVIDENCE OF TWO SAMPLES , 1933 .

[8]  Tsvi Kuflik,et al.  Second workshop on information heterogeneity and fusion in recommender systems (HetRec2011) , 2011, RecSys '11.

[9]  Hans Hallez,et al.  Towards Privacy-preserving Mobile Applications with Federated Learning: The Case of Matrix Factorization (poster) , 2019, MobiSys.

[10]  Xing Xie,et al.  Privacy-Preserving News Recommendation Model Learning , 2020, EMNLP.

[11]  Matthew J. Streeter,et al.  An Online Algorithm for Maximizing Submodular Functions , 2008, NIPS.

[12]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[13]  Barry Smyth,et al.  FedFast: Going Beyond Average for Faster Training of Federated Recommender Systems , 2020, KDD.

[14]  Kai Chen,et al.  Secure Federated Matrix Factorization , 2019, IEEE Intelligent Systems.

[15]  Sebastian Caldas,et al.  Expanding the Reach of Federated Learning by Reducing Client Resource Requirements , 2018, ArXiv.

[16]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[17]  Abhimanyu Dubey,et al.  Differentially-Private Federated Linear Bandits , 2020, NeurIPS.

[18]  Murali Annavaram,et al.  Group Knowledge Transfer: Federated Learning of Large CNNs at the Edge , 2020, NeurIPS.

[19]  Shi Dong,et al.  An Information-Theoretic Analysis for Thompson Sampling with Many Actions , 2018, NeurIPS.

[20]  Shipra Agrawal,et al.  Further Optimal Regret Bounds for Thompson Sampling , 2012, AISTATS.

[21]  Benjamin Van Roy,et al.  An Information-Theoretic Analysis of Thompson Sampling , 2014, J. Mach. Learn. Res..

[22]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[23]  Kuan Eeik Tan,et al.  Federated Collaborative Filtering for Privacy-Preserving Personalized Recommendation System , 2019, ArXiv.

[24]  Xing Xie,et al.  MIND: A Large-scale Dataset for News Recommendation , 2020, ACL.

[25]  Lihong Li,et al.  An Empirical Evaluation of Thompson Sampling , 2011, NIPS.

[26]  Jiangcheng Qin,et al.  A Novel Privacy-Preserved Recommender System Framework Based On Federated Learning , 2020, ICSIM.

[27]  Bingsheng He,et al.  A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection , 2019, IEEE Transactions on Knowledge and Data Engineering.

[28]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[29]  Atsuyoshi Nakamura,et al.  Algorithms for Adversarial Bandit Problems with Multiple Plays , 2010, ALT.

[30]  W. R. Thompson On the Theory of Apportionment , 1935 .

[31]  Pan Zhou,et al.  A Privacy-Preserving Distributed Contextual Federated Online Learning Framework with Big Data Support in Social Recommender Systems , 2019, IEEE Transactions on Knowledge and Data Engineering.

[32]  Long Tran-Thanh,et al.  Efficient Thompson Sampling for Online Matrix-Factorization Recommendation , 2015, NIPS.

[33]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[34]  Steven L. Scott,et al.  A modern Bayesian look at the multi-armed bandit , 2010 .

[35]  Xing Xie,et al.  Privacy-Preserving News Recommendation Model Training via Federated Learning , 2020, ArXiv.

[36]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[37]  Daniel Fink A Compendium of Conjugate Priors , 1997 .

[38]  Bengt J. Nilsson,et al.  Ensemble Recommendations via Thompson Sampling: an Experimental Study within e-Commerce , 2018, IUI.

[39]  Shie Mannor,et al.  Thompson Sampling for Complex Online Problems , 2013, ICML.

[40]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[41]  Klaus-Robert Müller,et al.  Robust and Communication-Efficient Federated Learning From Non-i.i.d. Data , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[42]  Kin K. Leung,et al.  Adaptive Gradient Sparsification for Efficient Federated Learning: An Online Learning Approach , 2020, ArXiv.

[43]  Suleiman A. Khan,et al.  Federated Multi-view Matrix Factorization for Personalized Recommendations , 2020, ECML/PKDD.

[44]  Peter Richtárik,et al.  Federated Learning: Strategies for Improving Communication Efficiency , 2016, ArXiv.

[45]  Max Chevalier,et al.  A Multiple-Play Bandit Algorithm Applied to Recommender Systems , 2015, FLAIRS.

[46]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.