Network Coding for Federated Learning Systems

Nowadays, artificial intelligence is limited by privacy and security problems. Compared with the ordinary machine learning, federated learning (FL) enables multiple participants to collaboratively learn a shared machine learning model while keeping all the training data on local devices. However, most of the current secured federated learning systems (FLSs) are built up with high computational and communication costs. On the other hand, optimizing the network structure of federated learning systems can reduce communication complexity by considering the correlation of the transmission channels.

[1]  Vitaly Shmatikov,et al.  Privacy-preserving deep learning , 2015, 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[2]  Yunnan Wu,et al.  Network coding for distributed storage systems , 2010, IEEE Trans. Inf. Theory.

[3]  Ian Goodfellow,et al.  Deep Learning with Differential Privacy , 2016, CCS.

[4]  Qiang Yang,et al.  Federated Machine Learning , 2019, ACM Trans. Intell. Syst. Technol..

[5]  Stephen J. Wright,et al.  Hogwild: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent , 2011, NIPS.

[6]  Frank R. Kschischang,et al.  Reliable and Secure Multishot Network Coding Using Linearized Reed-Solomon Codes , 2019, IEEE Transactions on Information Theory.

[7]  Moni Naor,et al.  Our Data, Ourselves: Privacy Via Distributed Noise Generation , 2006, EUROCRYPT.

[8]  Krishna R. Narayanan,et al.  Weakly Secure Network Coding , 2005 .

[9]  Aderemi A. Atayero,et al.  Security Issues in Cloud Computing: The Potentials of Homomorphic Encryption , 2011 .

[10]  Shiho Moriai,et al.  Privacy-Preserving Deep Learning via Additively Homomorphic Encryption , 2018, IEEE Transactions on Information Forensics and Security.

[11]  C. Fragouli,et al.  A Network Coding Approach to Network Monitoring (Invited Paper) , 2005 .

[12]  Mubashir Husain Rehmani,et al.  Network Coding in Cognitive Radio Networks: A Comprehensive Survey , 2017, IEEE Communications Surveys & Tutorials.

[13]  Lei Ye,et al.  An Integrated Fast Data Transmission Scheme Based on Network Coding , 2019, IEEE Access.

[14]  Shuo-Yen Robert Li,et al.  Linear network coding , 2003, IEEE Trans. Inf. Theory.

[15]  Marc'Aurelio Ranzato,et al.  Large Scale Distributed Deep Networks , 2012, NIPS.