Fairness and Privacy-Preserving in Federated Learning: A Survey

Federated learning (FL) as distributed machine learning has gained popularity as privacy-aware Machine Learning (ML) systems have emerged as a technique that prevents privacy leakage by building a global model and by conducting individualized training of decentralized edge clients on their own private data. The existing works, however, employ privacy mechanisms such as Secure Multiparty Computing (SMC), Differential Privacy (DP), etc. Which are immensely susceptible to interference, massive computational overhead, low accuracy, etc. With the increasingly broad deployment of FL systems, it is challenging to ensure fairness and maintain active client participation in FL systems. Very few works ensure reasonably satisfactory performances for the numerous diverse clients and fail to prevent potential bias against particular demographics in FL systems. The current efforts fail to strike a compromise between privacy, fairness, and model performance in FL systems and are vulnerable to a number of additional problems. In this paper, we provide a comprehensive survey stating the basic concepts of FL, the existing privacy challenges, techniques, and relevant works concerning privacy in FL. We also provide an extensive overview of the increasing fairness challenges, existing fairness notions, and the limited works that attempt both privacy and fairness in FL. By comprehensively describing the existing FL systems, we present the potential future directions pertaining to the challenges of privacy-preserving and fairness-aware FL systems.

[1]  Flora D. Salim,et al.  Equalised Odds is not Equal Individual Odds: Post-processing for Group and Individual Fairness , 2023, ArXiv.

[2]  Yuanming Shi,et al.  Online Client Selection for Asynchronous Federated Learning With Fairness Consideration , 2023, IEEE Transactions on Wireless Communications.

[3]  Sin Kit Lo,et al.  Toward Trustworthy AI: Blockchain-Based Architecture Design for Accountability and Fairness of Federated Learning Systems , 2023, IEEE Internet of Things Journal.

[4]  Jiayu Zhou,et al.  A Privacy-Preserving Hybrid Federated Learning Framework for Financial Crime Detection , 2023, ArXiv.

[5]  H. Song,et al.  Privacy-Preserving Federated Learning for Industrial Edge Computing via Hybrid Differential Privacy and Adaptive Compression , 2023, IEEE Transactions on Industrial Informatics.

[6]  S. Mao,et al.  Truthful Incentive Mechanism for Federated Learning with Crowdsourced Data Labeling , 2023, IEEE INFOCOM 2023 - IEEE Conference on Computer Communications.

[7]  Lung-Chuang Wang,et al.  FedEBA+: Towards Fair and Effective Federated Learning via Entropy-Based Model , 2023, ArXiv.

[8]  Alycia N. Carey,et al.  Robust Personalized Federated Learning under Demographic Fairness Heterogeneity , 2022, 2022 IEEE International Conference on Big Data (Big Data).

[9]  Wensheng Gan,et al.  Federated Learning Attacks and Defenses: A Survey , 2022, 2022 IEEE International Conference on Big Data (Big Data).

[10]  Zibin Zheng,et al.  Heterogeneity-aware fair federated learning , 2022, Information Sciences.

[11]  Diep N. Nguyen,et al.  High-accuracy low-cost privacy-preserving federated learning in IoT systems via adaptive perturbation , 2022, J. Inf. Secur. Appl..

[12]  N. Yu,et al.  Privacy-Preserving Federated Learning Using Homomorphic Encryption With Different Encryption Keys , 2022, Information and Communication Technology Convergence.

[13]  E. Larsson,et al.  Over-the-Air Federated Learning with Privacy Protection via Correlated Additive Perturbations , 2022, 2022 58th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[14]  Miguel X. Fernandes,et al.  FAIR-FATE: Fair Federated Learning with Momentum , 2022, arXiv.org.

[15]  Yingqiang Ge,et al.  Fairness-aware Federated Matrix Factorization , 2022, RecSys.

[16]  Mehrtash Harandi,et al.  Defense against Privacy Leakage in Federated Learning , 2022, ArXiv.

[17]  Yang Cao,et al.  Secure Shapley Value for Cross-Silo Federated Learning , 2022, Proc. VLDB Endow..

[18]  A. Korolova,et al.  "You Can't Fix What You Can't Measure": Privately Measuring Demographic Performance Disparities in Federated Learning , 2022, AFCP.

[19]  Zachary B. Charles,et al.  Motley: Benchmarking Heterogeneity and Personalization in Federated Learning , 2022, ArXiv.

[20]  C. Palamidessi,et al.  Group privacy for personalized federated learning , 2022, ICISSP.

[21]  Chuhan Wu,et al.  FairVFL: A Fair Vertical Federated Learning Framework with Contrastive Adversarial Learning , 2022, NeurIPS.

[22]  Bo Jiang,et al.  Towards Group Fairness via Semi-Centralized Adversarial Training in Federated Learning , 2022, 2022 23rd IEEE International Conference on Mobile Data Management (MDM).

[23]  Eric T. Nalisnick,et al.  On the impact of non-IID data on the performance and fairness of differentially private federated learning , 2022, 2022 52nd Annual IEEE/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W).

[24]  Martine De Cock,et al.  PrivFairFL: Privacy-Preserving Group Fairness in Federated Learning , 2022, ArXiv.

[25]  Miao Yang,et al.  Client Selection for Asynchronous Federated Learning with Fairness Consideration , 2022, 2022 IEEE International Conference on Communications Workshops (ICC Workshops).

[26]  Kwok-Yan Lam,et al.  Privacy-Preserving Aggregation in Federated Learning: A Survey , 2022, IEEE Transactions on Big Data.

[27]  Won Joon Yun,et al.  SlimFL: Federated Learning with Superposition Coding over Slimmable Neural Networks , 2022, IEEE/ACM Transactions on Networking.

[28]  Zhiwei Steven Wu,et al.  Fair Federated Learning via Bounded Group Loss , 2022, 2203.10190.

[29]  P. Varshney,et al.  Federated Minimax Optimization: Improved Convergence Analyses and Algorithms , 2022, ICML.

[30]  Teng Liu,et al.  AFLPC: An Asynchronous Federated Learning Privacy-Preserving Computing Model Applied to 5G-V2X , 2022, Security and Communication Networks.

[31]  Jens Grossklags,et al.  Comprehensive Analysis of Privacy Leakage in Vertical Federated Learning During Prediction , 2022, Proc. Priv. Enhancing Technol..

[32]  Yiran Chen,et al.  Privacy Leakage of Adversarial Training Models in Federated Learning Systems , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[33]  Jun Li,et al.  Vertical Federated Learning: Challenges, Methodologies and Experiments , 2022, ArXiv.

[34]  Guillermo Sapiro,et al.  Minimax Demographic Group Fairness in Federated Learning , 2022, FAccT.

[35]  Preston Putzel,et al.  Blackbox Post-Processing for Multiclass Fairness , 2022, SafeAI@AAAI.

[36]  Jieyu Lin,et al.  A Multi-agent Reinforcement Learning Approach for Efficient Client Selection in Federated Learning , 2022, AAAI.

[37]  Michael P. Friedlander,et al.  Fair and efficient contribution valuation for vertical federated learning , 2022, ArXiv.

[38]  Govind P. Gupta,et al.  PEFL: Deep Privacy-Encoding-Based Federated Learning Framework for Smart Agriculture , 2022, IEEE Micro.

[39]  Chunhua Shen,et al.  DENSE: Data-Free One-Shot Federated Learning , 2021, NeurIPS.

[40]  Prateek Mittal,et al.  SparseFed: Mitigating Model Poisoning Attacks in Federated Learning with Sparsification , 2021, AISTATS.

[41]  Lixing Chen,et al.  Context-Aware Online Client Selection for Hierarchical Federated Learning , 2021, IEEE Transactions on Parallel and Distributed Systems.

[42]  Sanjeev Arora,et al.  Evaluating Gradient Inversion Attacks and Defenses in Federated Learning , 2021, NeurIPS.

[43]  Roberto Iglesias,et al.  Non-IID data and Continual Learning processes in Federated Learning: A long road ahead , 2021, Inf. Fusion.

[44]  Dusit Niyato,et al.  Incentive Mechanisms for Federated Learning: From Economic and Game Theoretic Perspective , 2021, IEEE Transactions on Cognitive Communications and Networking.

[45]  G. Neglia,et al.  Personalized Federated Learning through Local Memorization , 2021, ICML.

[46]  Graham W. Taylor,et al.  Federated learning and differential privacy for medical image analysis , 2021, Scientific Reports.

[47]  Kun Kuang,et al.  Unified Group Fairness on Federated Learning , 2021, ArXiv.

[48]  Han Yu,et al.  Towards Fairness-Aware Federated Learning. , 2021, IEEE transactions on neural networks and learning systems.

[49]  Chen Wang,et al.  Safeguarding cross-silo federated learning with local differential privacy , 2021, Digit. Commun. Networks.

[50]  Kangwook Lee,et al.  Improving Fairness via Federated Learning , 2021, ArXiv.

[51]  Guillermo Sapiro,et al.  Federating for Learning Group Fair Models , 2021, ArXiv.

[52]  Yahya H. Ezzeldin,et al.  FairFed: Enabling Group Fairness in Federated Learning , 2021, AAAI.

[53]  Xiuzhen Cheng,et al.  Decentralized Wireless Federated Learning With Differential Privacy , 2021, IEEE Transactions on Industrial Informatics.

[54]  Borja Rodr'iguez G'alvez,et al.  Enforcing fairness in private federated learning via the modified method of differential multipliers , 2021, ArXiv.

[55]  Minyu Shi,et al.  An adaptive federated learning scheme with differential privacy preserving , 2021, Future Gener. Comput. Syst..

[56]  Gillian Dobbie,et al.  Source Inference Attacks in Federated Learning , 2021, 2021 IEEE International Conference on Data Mining (ICDM).

[57]  Philippe Lalanda,et al.  A distillation-based approach integrating continual learning and federated learning for pervasive services , 2021, ArXiv.

[58]  Samhita Kanaparthy,et al.  F3: Fair and Federated Face Attribute Classification with Heterogeneous Data , 2021, PAKDD.

[59]  Lizhen Cui,et al.  GTG-Shapley: Efficient and Accurate Participant Contribution Evaluation in Federated Learning , 2021, ACM Trans. Intell. Syst. Technol..

[60]  Wei Wang,et al.  FLASHE: Additively Symmetric Homomorphic Encryption for Cross-Silo Federated Learning , 2021, ArXiv.

[61]  Ruthu Hulikal Rooparaghunath,et al.  Poster: FLATEE: Federated Learning Across Trusted Execution Environments , 2021, 2021 IEEE European Symposium on Security and Privacy (EuroS&P).

[62]  Sujit Gujar,et al.  Federated Learning Meets Fairness and Differential Privacy , 2021, ICONIP.

[63]  Chunyan Miao,et al.  A Contract Theory based Incentive Mechanism for Federated Learning , 2021, ArXiv.

[64]  Minyi Guo,et al.  Dubhe: Towards Data Unbiasedness with Homomorphic Encryption in Federated Learning Client Selection , 2021, ICPP.

[65]  Li Li,et al.  FIFL: A Fair Incentive Mechanism for Federated Learning , 2021, ICPP.

[66]  Xubo Yue,et al.  GIFAIR-FL: A Framework for Group and Individual Fairness in Federated Learning , 2021, INFORMS Journal on Data Science.

[67]  Jiayu Zhou,et al.  Federated Adversarial Debiasing for Fair and Transferable Representations , 2021, KDD.

[68]  Witold Pedrycz,et al.  The Concept of Granular Representation of the Information Potential of Variables , 2021, 2021 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[69]  Xuefei Yin,et al.  A Comprehensive Survey of Privacy-preserving Federated Learning , 2021, ACM Comput. Surv..

[70]  Tiasa Singha Roy,et al.  Benchmarking Differential Privacy and Federated Learning for BERT Models , 2021, ArXiv.

[71]  Jinfeng Yi,et al.  Understanding Clipping for Federated Learning: Convergence and Client-Level Differential Privacy , 2021, ICML.

[72]  Haojin Zhu,et al.  BatFL: Backdoor Detection on Federated Learning in e-Health , 2021, 2021 IEEE/ACM 29th International Symposium on Quality of Service (IWQOS).

[73]  Wensheng Xia,et al.  A Vertical Federated Learning Framework for Horizontally Partitioned Labels , 2021, ArXiv.

[74]  Xiaosong Zhang,et al.  Blockchain-Enabled Federated Learning Data Protection Aggregation Scheme With Differential Privacy and Homomorphic Encryption in IIoT , 2021, IEEE Transactions on Industrial Informatics.

[75]  Meiqi Wang,et al.  Federated Regularization Learning: an Accurate and Safe Method for Federated Learning , 2021, 2021 IEEE 3rd International Conference on Artificial Intelligence Circuits and Systems (AICAS).

[76]  Sung Kuk Shyn,et al.  FedCCEA : A Practical Approach of Client Contribution Evaluation for Federated Learning , 2021, ArXiv.

[77]  Hridesh Rajan,et al.  Fair preprocessing: towards understanding compositional fairness of data transformers in machine learning pipeline , 2021, ESEC/SIGSOFT FSE.

[78]  Chunhua Su,et al.  COFEL: Communication-Efficient and Optimized Federated Learning with Local Differential Privacy , 2021, ICC 2021 - IEEE International Conference on Communications.

[79]  Jiayu Zhou,et al.  Data-Free Knowledge Distillation for Heterogeneous Federated Learning , 2021, ICML.

[80]  Ramasuri Narayanam,et al.  Game of Gradients: Mitigating Irrelevant Clients in Federated Learning , 2021, AAAI.

[81]  Songtao Lu,et al.  An Efficient Learning Framework for Federated XGBoost Using Secret Sharing and Distributed Optimization , 2021, ACM Trans. Intell. Syst. Technol..

[82]  Dan Meng,et al.  ShuffleFL: gradient-preserving federated learning using trusted execution environment , 2021, CF.

[83]  Jie Shao,et al.  A Federated Learning Approach for Privacy Protection in Context-Aware Recommender Systems , 2021, Comput. J..

[84]  Jianzhong Qi,et al.  Federated Learning with Fair Averaging , 2021, IJCAI.

[85]  Ji Liu,et al.  From distributed machine learning to federated learning: a survey , 2021, Knowledge and Information Systems.

[86]  Stephan Sigg,et al.  Privacy‐preserving federated learning based on multi‐key homomorphic encryption , 2021, Int. J. Intell. Syst..

[87]  Mohsen Guizani,et al.  A Survey on Federated Learning: The Journey From Centralized to Distributed On-Site Learning and Beyond , 2021, IEEE Internet of Things Journal.

[88]  Shamkant B. Navathe,et al.  OmniFair: A Declarative System for Model-Agnostic Group Fairness in Machine Learning , 2021, SIGMOD Conference.

[89]  Nicholas D. Lane,et al.  FjORD: Fair and Accurate Federated Learning under heterogeneous targets with Ordered Dropout , 2021, NeurIPS.

[90]  Somesh Jha,et al.  CaPC Learning: Confidential and Private Collaborative Learning , 2021, ICLR.

[91]  Onur Günlü,et al.  Federated Learning with Local Differential Privacy: Trade-Offs Between Privacy, Utility, and Communication , 2021, ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[92]  Kai Fan,et al.  Anonymous and Privacy-Preserving Federated Learning With Industrial Big Data , 2021, IEEE Transactions on Industrial Informatics.

[93]  Tianrui Li,et al.  Fairness and Accuracy in Federated Learning , 2020, ArXiv.

[94]  Ziyi Kou,et al.  FairFL: A Fair Federated Learning Approach to Reducing Demographic Bias in Privacy-Sensitive Classification Models , 2020, 2020 IEEE International Conference on Big Data (Big Data).

[95]  Virginia Smith,et al.  Ditto: Fair and Robust Federated Learning Through Personalization , 2020, ICML.

[96]  Philip S. Yu,et al.  Privacy and Robustness in Federated Learning: Attacks and Defenses , 2020, IEEE transactions on neural networks and learning systems.

[97]  Heiko Ludwig,et al.  Mitigating Bias in Federated Learning , 2020, ArXiv.

[98]  M. Pan,et al.  Towards Efficient Secure Aggregation for Model Update in Federated Learning , 2020, Global Communications Conference.

[99]  Lingjuan Lyu,et al.  A Reputation Mechanism Is All You Need: Collaborative Fairness and Adversarial Robustness in Federated Learning , 2020, 2011.10464.

[100]  Amos J. Storkey,et al.  Latent Adversarial Debiasing: Mitigating Collider Bias in Deep Neural Networks , 2020, ArXiv.

[101]  Albert Y. Zomaya,et al.  Stochastic Client Selection for Federated Learning With Volatile Clients , 2020, IEEE Internet of Things Journal.

[102]  Dimitrios Papadopoulos,et al.  Mitigating Leakage in Federated Learning with Trusted Hardware , 2020, ArXiv.

[103]  Albert Y. Zomaya,et al.  An Efficiency-Boosting Client Selection Scheme for Federated Learning With Fairness Guarantee , 2020, IEEE Transactions on Parallel and Distributed Systems.

[104]  Jonathan Passerat-Palmbach,et al.  Blockchain-orchestrated machine learning for privacy preserving federated learning in electronic health data , 2020, 2020 IEEE International Conference on Blockchain (Blockchain).

[105]  Yang Qin,et al.  A Selective Model Aggregation Approach in Federated Learning for Online Anomaly Detection , 2020, 2020 International Conferences on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) and IEEE Congress on Cybermatics (Cybermatics).

[106]  Osman Yagan,et al.  Bandit-based Communication-Efficient Client Selection Strategies for Federated Learning , 2020, 2020 54th Asilomar Conference on Signals, Systems, and Computers.

[107]  M. Chowdhury,et al.  Oort: Efficient Federated Learning via Guided Participant Selection , 2020, OSDI.

[108]  Jianyu Wang,et al.  Client Selection in Federated Learning: Convergence Analysis and Power-of-Choice Selection Strategies , 2020, ArXiv.

[109]  Walid Saad,et al.  Federated Learning for Internet of Things: Recent Advances, Taxonomy, and Open Challenges , 2020, IEEE Communications Surveys & Tutorials.

[110]  Sudipan Saha,et al.  Federated Transfer Learning: concept and applications , 2020, Intelligenza Artificiale.

[111]  Emiliano De Cristofaro,et al.  Local and Central Differential Privacy for Robustness and Privacy in Federated Learning , 2020, NDSS.

[112]  Yong Li,et al.  Privacy-Preserving Federated Learning Framework Based on Chained Secure Multiparty Computing , 2020, IEEE Internet of Things Journal.

[113]  Alan Mishler,et al.  Fairness in Risk Assessment Instruments: Post-Processing to Achieve Counterfactual Equalized Odds , 2020, FAccT.

[114]  Mingkai Huang,et al.  Hybrid Differentially Private Federated Learning on Vertically Partitioned Data , 2020, ArXiv.

[115]  Lingjuan Lyu,et al.  Collaborative Fairness in Federated Learning , 2020, Federated Learning.

[116]  Lawrence Carin,et al.  WAFFLe: Weight Anonymized Factorization for Federated Learning , 2020, IEEE Access.

[117]  Philip S. Yu,et al.  LDP-FL: Practical Private Aggregation in Federated Learning with Local Differential Privacy , 2020, IJCAI.

[118]  Kai Chen,et al.  FPGA-Based Hardware Accelerator of Homomorphic Encryption for Efficient Federated Learning , 2020, ArXiv.

[119]  Tim Menzies,et al.  Making Fair ML Software using Trustworthy Explanation , 2020, 2020 35th IEEE/ACM International Conference on Automated Software Engineering (ASE).

[120]  Tony Q. S. Quek,et al.  Multi-Armed Bandit-Based Client Scheduling for Federated Learning , 2020, IEEE Transactions on Wireless Communications.

[121]  Virginia Smith,et al.  Tilted Empirical Risk Minimization , 2020, ICLR.

[122]  Francisco Herrera,et al.  Federated Learning and Differential Privacy: Software tools analysis, the Sherpa.ai FL framework and methodological guidelines for preserving data privacy , 2020, Inf. Fusion.

[123]  Tianjian Chen,et al.  A Secure Federated Transfer Learning Framework , 2020, IEEE Intelligent Systems.

[124]  Hao Wang,et al.  Optimizing Federated Learning on Non-IID Data with Reinforcement Learning , 2020, IEEE INFOCOM 2020 - IEEE Conference on Computer Communications.

[125]  K. Shaloudegi,et al.  Federated Learning Meets Multi-Objective Optimization , 2020, IEEE Transactions on Network Science and Engineering.

[126]  Bingsheng He,et al.  The OARF Benchmark Suite: Characterization and Implications for Federated Learning Systems , 2020, ACM Trans. Intell. Syst. Technol..

[127]  Zhifei Zhang,et al.  Analyzing User-Level Privacy Attack Against Federated Learning , 2020, IEEE Journal on Selected Areas in Communications.

[128]  Jalil Taghia,et al.  Ensemble-based Synthetic Data Synthesis for Federated QoE Modeling , 2020, 2020 6th IEEE Conference on Network Softwarization (NetSoft).

[129]  Jianfeng Ma,et al.  Privacy-preserving federated k-means for proactive caching in next generation cellular networks , 2020, Inf. Sci..

[130]  Tao Xiang,et al.  A training-integrity privacy-preserving federated learning scheme with trusted execution environment , 2020, Inf. Sci..

[131]  Shubo Liu,et al.  IFed: A novel federated learning framework for local differential privacy in Power Internet of Things , 2020, Int. J. Distributed Sens. Networks.

[132]  Wei Yang,et al.  Private FL-GAN: Differential Privacy Synthetic Data Generation Based on Federated Learning , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[133]  Rui Hu,et al.  Personalized Federated Learning With Differential Privacy , 2020, IEEE Internet of Things Journal.

[134]  Wenqi Wei,et al.  LDP-Fed: federated learning with local differential privacy , 2020, EdgeSys@EuroSys.

[135]  Seyit Camtepe,et al.  Privacy Preserving Distributed Machine Learning with Federated Learning , 2020, Comput. Commun..

[136]  Antonio Robles-Kelly,et al.  Hierarchically Fair Federated Learning , 2020, ArXiv.

[137]  Jun Zhao,et al.  Local Differential Privacy-Based Federated Learning for Internet of Things , 2020, IEEE Internet of Things Journal.

[138]  Han Yu,et al.  Threats to Federated Learning: A Survey , 2020, ArXiv.

[139]  Haris Vikalo,et al.  Federating Recommendations Using Differentially Private Prototypes , 2020, Pattern Recognit..

[140]  Manzil Zaheer,et al.  Adaptive Federated Optimization , 2020, ICLR.

[141]  Xue Yang,et al.  An Accuracy-Lossless Perturbation Method for Defending Privacy Attacks in Federated Learning , 2020, WWW.

[142]  Aris Gkoulalas-Divanis,et al.  Anonymizing Data for Privacy-Preserving Federated Learning , 2020, ArXiv.

[143]  Yasaman Khazaeni,et al.  Federated Learning with Matched Averaging , 2020, ICLR.

[144]  Ming Li,et al.  Wireless Federated Learning with Local Differential Privacy , 2020, 2020 IEEE International Symposium on Information Theory (ISIT).

[145]  Tianjian Chen,et al.  A Fairness-aware Incentive Scheme for Federated Learning , 2020, AIES.

[146]  K. Leung,et al.  Adaptive Gradient Sparsification for Efficient Federated Learning: An Online Learning Approach , 2020, 2020 IEEE 40th International Conference on Distributed Computing Systems (ICDCS).

[147]  Amir Houmansadr,et al.  Cronus: Robust and Heterogeneous Collaborative Learning with Black-Box Knowledge Transfer , 2019, ArXiv.

[148]  Shusen Yang,et al.  Asynchronous Federated Learning with Differential Privacy for Edge Intelligence , 2019, ArXiv.

[149]  Richard Nock,et al.  Advances and Open Problems in Federated Learning , 2019, Found. Trends Mach. Learn..

[150]  Shihao Ji,et al.  Learning with Multiplicative Perturbations , 2019, 2020 25th International Conference on Pattern Recognition (ICPR).

[151]  Di Cao,et al.  Understanding Distributed Poisoning Attack in Federated Learning , 2019, 2019 IEEE 25th International Conference on Parallel and Distributed Systems (ICPADS).

[152]  Han Yu,et al.  Privacy-preserving Heterogeneous Federated Transfer Learning , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[153]  Shuyue Wei,et al.  Profit Allocation for Federated Learning , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[154]  B. Faltings,et al.  Federated Learning with Bayesian Differential Privacy , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[155]  Bing Ren,et al.  Parallel Distributed Logistic Regression for Vertical Federated Learning without Third-Party Coordinator , 2019, ArXiv.

[156]  Nathalie Baracaldo,et al.  HybridAlpha: An Efficient Approach for Privacy-Preserving Federated Learning , 2019, AISec@CCS.

[157]  Walid Saad,et al.  Federated Learning for Edge Networks: Resource Optimization and Incentive Mechanism , 2019, IEEE Communications Magazine.

[158]  Vyas Sekar,et al.  Enhancing the Privacy of Federated Learning with Sketching , 2019, ArXiv.

[159]  Shashi Raj Pandey,et al.  A Crowdsourcing Framework for On-Device Federated Learning , 2019, IEEE Transactions on Wireless Communications.

[160]  H. Vincent Poor,et al.  Federated Learning With Differential Privacy: Algorithms and Performance Analysis , 2019, IEEE Transactions on Information Forensics and Security.

[161]  Sashank J. Reddi,et al.  SCAFFOLD: Stochastic Controlled Averaging for Federated Learning , 2019, ICML.

[162]  Theodoros Salonidis,et al.  Differential Privacy-enabled Federated Learning for Sensitive Health Data , 2019, arXiv.org.

[163]  Jakub Konecný,et al.  Improving Federated Learning Personalization via Model Agnostic Meta Learning , 2019, ArXiv.

[164]  Ziye Zhou,et al.  Measure Contribution of Participants in Federated Learning , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[165]  Pranjal Awasthi,et al.  Equalized odds postprocessing under imperfect group information , 2019, AISTATS.

[166]  Song Han,et al.  Deep Leakage from Gradients , 2019, NeurIPS.

[167]  Tian Li,et al.  Fair Resource Allocation in Federated Learning , 2019, ICLR.

[168]  Chuishi Meng,et al.  Federated Forest , 2019, IEEE Transactions on Big Data.

[169]  Ying-Chang Liang,et al.  Incentive Design for Efficient Federated Learning in Mobile Networks: A Contract Theory Approach , 2019, 2019 IEEE VTS Asia Pacific Wireless Communications Symposium (APWCS).

[170]  Guan Wang,et al.  Interpret Federated Learning with Shapley Values , 2019, ArXiv.

[171]  James Y. Zou,et al.  Data Shapley: Equitable Valuation of Data for Machine Learning , 2019, ICML.

[172]  Mehryar Mohri,et al.  Agnostic Federated Learning , 2019, ICML.

[173]  Qiang Yang,et al.  SecureBoost: A Lossless Federated Learning Framework , 2019, IEEE Intelligent Systems.

[174]  Kush R. Varshney,et al.  Bias Mitigation Post-processing for Individual and Group Fairness , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[175]  Rui Zhang,et al.  A Hybrid Approach to Privacy-Preserving Federated Learning , 2018, Informatik Spektrum.

[176]  Amir Houmansadr,et al.  Comprehensive Privacy Analysis of Deep Learning: Passive and Active White-box Inference Attacks against Centralized and Federated Learning , 2018, 2019 IEEE Symposium on Security and Privacy (SP).

[177]  Yang Song,et al.  Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learning , 2018, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[178]  Gaurav Kapoor,et al.  Protection Against Reconstruction and Its Applications in Private Federated Learning , 2018, ArXiv.

[179]  Nitin H. Vaidya,et al.  Privacy-Preserving Distributed Learning via Obfuscated Stochastic Gradients , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[180]  Ivan Beschastnikh,et al.  Dancing in the Dark: Private Multi-Party Machine Learning in an Untrusted Setting , 2018, ArXiv.

[181]  Jung Hee Cheon,et al.  Logistic regression model training based on the approximate homomorphic encryption , 2018, BMC Medical Genomics.

[182]  James Y. Zou,et al.  Multiaccuracy: Black-Box Post-Processing for Fairness in Classification , 2018, AIES.

[183]  Takayuki Nishio,et al.  Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge , 2018, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[184]  Suresh Venkatasubramanian,et al.  A comparative study of fairness-enhancing interventions in machine learning , 2018, FAT.

[185]  Blake Lemoine,et al.  Mitigating Unwanted Biases with Adversarial Learning , 2018, AIES.

[186]  Tassilo Klein,et al.  Differentially Private Federated Learning: A Client Level Perspective , 2017, ArXiv.

[187]  H. Brendan McMahan,et al.  Learning Differentially Private Recurrent Language Models , 2017, ICLR.

[188]  Payman Mohassel,et al.  SecureML: A System for Scalable Privacy-Preserving Machine Learning , 2017, 2017 IEEE Symposium on Security and Privacy (SP).

[189]  Kush R. Varshney,et al.  Optimized Data Pre-Processing for Discrimination Prevention , 2017, ArXiv.

[190]  Ersin Uzun,et al.  Achieving Differential Privacy in Secure Multiparty Data Aggregation Protocols on Star Networks , 2017, CODASPY.

[191]  Giuseppe Ateniese,et al.  Deep Models Under the GAN: Information Leakage from Collaborative Deep Learning , 2017, CCS.

[192]  Sarvar Patel,et al.  Practical Secure Aggregation for Federated Learning on User-Held Data , 2016, ArXiv.

[193]  Nathan Srebro,et al.  Equality of Opportunity in Supervised Learning , 2016, NIPS.

[194]  Isabel Wagner,et al.  Evaluating the Strength of Genomic Privacy Metrics , 2016, ACM Trans. Priv. Secur..

[195]  David Eckhoff,et al.  Metrics : a Systematic Survey , 2018 .

[196]  Vitaly Shmatikov,et al.  Privacy-preserving deep learning , 2015, 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[197]  Jun Sakuma,et al.  Fairness-Aware Classifier with Prejudice Remover Regularizer , 2012, ECML/PKDD.

[198]  Jun Sakuma,et al.  Fairness-aware Learning through Regularization Approach , 2011, 2011 IEEE 11th International Conference on Data Mining Workshops.

[199]  Amos Beimel,et al.  Secret-Sharing Schemes: A Survey , 2011, IWCC.

[200]  Jean-Yves Le Boudec,et al.  Quantifying Location Privacy , 2011, 2011 IEEE Symposium on Security and Privacy.

[201]  Toniann Pitassi,et al.  Fairness through awareness , 2011, ITCS '12.

[202]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[203]  Peter L. Bartlett,et al.  Classification with a Reject Option using a Hinge Loss , 2008, J. Mach. Learn. Res..

[204]  Sofya Raskhodnikova,et al.  What Can We Learn Privately? , 2008, 2008 49th Annual IEEE Symposium on Foundations of Computer Science.

[205]  Ninghui Li,et al.  t-Closeness: Privacy Beyond k-Anonymity and l-Diversity , 2007, 2007 IEEE 23rd International Conference on Data Engineering.

[206]  Radu Herbei,et al.  Classification with reject option , 2006 .

[207]  Sushil Jajodia,et al.  The Role of Quasi-identifiers in k-Anonymity Revisited , 2006, ArXiv.

[208]  Latanya Sweeney,et al.  k-Anonymity: A Model for Protecting Privacy , 2002, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[209]  Rathindra Sarathy,et al.  A General Additive Data Perturbation Method for Database Security , 1999 .

[210]  Pascal Paillier,et al.  Public-Key Cryptosystems Based on Composite Degree Residuosity Classes , 1999, EUROCRYPT.

[211]  Adi Shamir,et al.  How to share a secret , 1979, CACM.

[212]  Junxue Zhang,et al.  FLASH: Towards a High-performance Hardware Acceleration Architecture for Cross-silo Federated Learning , 2023, NSDI.

[213]  P. Vijayakumar,et al.  Homomorphic Encryption-Based Privacy-Preserving Federated Learning in IoT-Enabled Healthcare System , 2023, IEEE Transactions on Network Science and Engineering.

[214]  Ahmed El Ouadrhiri,et al.  Differential Privacy for Deep and Federated Learning: A Survey , 2022, IEEE Access.

[215]  Xiao-Yu Zhang,et al.  Privacy-Preserving Federated Learning for Value-Added Service Model in Advanced Metering Infrastructure , 2022, IEEE Transactions on Computational Social Systems.

[216]  C. Angulo,et al.  Synthetic Data for Anonymization in Secure Data Spaces for Federated Learning , 2022, International Conference of the Catalan Association for Artificial Intelligence.

[217]  Lingjuan Lyu,et al.  A Practical Data-Free Approach to One-shot Federated Learning with Heterogeneity , 2021, ArXiv.

[218]  Suhas N. Diggavi,et al.  Shuffled Model of Differential Privacy in Federated Learning , 2021, AISTATS.

[219]  Yan Lei,et al.  A Verifiable Federated Learning Scheme Based on Secure Multi-party Computation , 2021, WASA.

[220]  Yang Liu,et al.  BatchCrypt: Efficient Homomorphic Encryption for Cross-Silo Federated Learning , 2020, USENIX ATC.

[221]  Kan Yang,et al.  VerifyNet: Secure and Verifiable Federated Learning , 2020, IEEE Transactions on Information Forensics and Security.

[222]  Theodoros Salonidis,et al.  A Syntactic Approach for Privacy-Preserving Federated Learning , 2020, ECAI.

[223]  Aryan Mokhtari,et al.  Personalized Federated Learning with Theoretical Guarantees: A Model-Agnostic Meta-Learning Approach , 2020, NeurIPS.

[224]  Fang Liu,et al.  EdgeFed: Optimized Federated Learning Based on Edge Computing , 2020, IEEE Access.

[225]  Zijun Guo,et al.  A homomorphic-encryption-based vertical federated learning scheme for rick management , 2020, Comput. Sci. Inf. Syst..

[226]  Sungwook Kim,et al.  Incentive Design and Differential Privacy Based Federated Learning: A Mechanism Design Perspective , 2020, IEEE Access.

[227]  Sebastian Schelter,et al.  Fairness-Aware Instrumentation of Preprocessing~Pipelines for Machine Learning , 2020 .

[228]  Vaikkunth Mugunthan,et al.  SMPAI: Secure Multi-Party Computation for Federated Learning , 2019 .

[229]  Frederik Vercauteren,et al.  Somewhat Practical Fully Homomorphic Encryption , 2012, IACR Cryptol. ePrint Arch..

[230]  Kannan Balasubramanian,et al.  Secure Multiparty Computation , 2011, Encyclopedia of Cryptography and Security.

[231]  Keke Chen,et al.  A Survey of Multiplicative Perturbation for Privacy-Preserving Data Mining , 2008, Privacy-Preserving Data Mining.

[232]  Kun Liu,et al.  A Survey of Attack Techniques on Privacy-Preserving Data Perturbation Methods , 2008, Privacy-Preserving Data Mining.