A review of applications in federated learning

Abstract Federated Learning (FL) is a collaboratively decentralized privacy-preserving technology to overcome challenges of data silos and data sensibility. Exactly what research is carrying the research momentum forward is a question of interest to research communities as well as industrial engineering. This study reviews FL and explores the main evolution path for issues exist in FL development process to advance the understanding of FL. This study aims to review prevailing application in industrial engineering to guide for the future landing application. This study also identifies six research fronts to address FL literature and help advance our understanding of FL for future optimization. This study contributes to conclude application in industrial engineering and computer science and summarize a review of applications in FL.

[1]  Piotr Indyk,et al.  Similarity Search in High Dimensions via Hashing , 1999, VLDB.

[2]  Sukhamay Kundu.  A Distributed O(|E|) Algorithm for Optimal Link-Reversal , 2009, ICDCN.

[3]  Mehryar Mohri,et al.  Agnostic Federated Learning , 2019, ICML.

[4]  Mert R. Sabuncu,et al.  Unsupervised Learning of Probabilistic Diffeomorphic Registration for Images and Surfaces , 2019, Medical Image Anal..

[5]  Choong Seon Hong,et al.  FLchain: Federated Learning via MEC-enabled Blockchain Network , 2019, 2019 20th Asia-Pacific Network Operations and Management Symposium (APNOMS).

[6]  Takayuki Nishio,et al.  Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge , 2018, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[7]  Li Huang,et al.  Patient Clustering Improves Efficiency of Federated Machine Learning to predict mortality and hospital stay time using distributed Electronic Medical Records , 2019, J. Biomed. Informatics.

[8]  Pan Li,et al.  Learning to Learn Gradient Aggregation by Gradient Descent , 2019, IJCAI.

[9]  Lei Ying,et al.  An Optimal Stopping Approach for Iterative Training in Federated Learning , 2020, 2020 54th Annual Conference on Information Sciences and Systems (CISS).

[10]  Li Chen,et al.  Accelerating Federated Learning via Momentum Gradient Descent , 2019, IEEE Transactions on Parallel and Distributed Systems.

[11]  Amir Houmansadr,et al.  Comprehensive Privacy Analysis of Deep Learning: Passive and Active White-box Inference Attacks against Centralized and Federated Learning , 2018, 2019 IEEE Symposium on Security and Privacy (SP).

[12]  Rui Zhang,et al.  A Hybrid Approach to Privacy-Preserving Federated Learning , 2019, AISec@CCS.

[13]  Yeong-Tae Song,et al.  A Secure and Scalable Data Source for Emergency Medical Care using Blockchain Technology , 2019, 2019 IEEE 17th International Conference on Software Engineering Research, Management and Applications (SERA).

[14]  Wei Shi,et al.  Federated learning of predictive models from federated Electronic Health Records , 2018, Int. J. Medical Informatics.

[15]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[16]  Haomiao Yang,et al.  Efficient and Privacy-Enhanced Federated Learning for Industrial Artificial Intelligence , 2020, IEEE Transactions on Industrial Informatics.

[17]  Huadong Ma,et al.  Federated Region-Learning: An Edge Computing Based Framework for Urban Environment Sensing , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[18]  Srinivasan Seshan,et al.  Learning Context-Aware Policies from Multiple Smart Homes via Federated Multi-Task Learning , 2020, 2020 IEEE/ACM Fifth International Conference on Internet-of-Things Design and Implementation (IoTDI).

[19]  Bing Chen,et al.  Poisoning Attack in Federated Learning using Generative Adversarial Nets , 2019, 2019 18th IEEE International Conference On Trust, Security And Privacy In Computing And Communications/13th IEEE International Conference On Big Data Science And Engineering (TrustCom/BigDataSE).

[20]  Haomiao Yang,et al.  Towards Efficient and Privacy-Preserving Federated Deep Learning , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[21]  Michael Naehrig,et al.  Private Predictive Analysis on Encrypted Medical Data , 2014, IACR Cryptol. ePrint Arch..

[22]  Z. Kennedy,et al.  Enhanced anti-counterfeiting measures for additive manufacturing: coupling lanthanide nanomaterial chemical signatures with blockchain technology , 2017 .

[23]  Sébastien Gambs,et al.  IOTFLA : A Secured and Privacy-Preserving Smart Home Architecture Implementing Federated Learning , 2019, 2019 IEEE Security and Privacy Workshops (SPW).

[24]  Nguyen H. Tran,et al.  Federated Learning-Based Cognitive Detection of Jamming Attack in Flying Ad-Hoc Network , 2020, IEEE Access.

[25]  Ming Liu,et al.  Federated Imitation Learning: A Novel Framework for Cloud Robotic Systems With Heterogeneous Sensor Data , 2019, IEEE Robotics and Automation Letters.

[26]  Eugene Kharitonov,et al.  Federated Online Learning to Rank with Evolution Strategies , 2019, WSDM.

[27]  Yong Wang,et al.  Preventive maintenance scheduling optimization based on opportunistic production-maintenance synchronization , 2020, J. Intell. Manuf..

[28]  Runhua Xu,et al.  HybridAlpha: An Efficient Approach for Privacy-Preserving Federated Learning , 2019, AISec@CCS.

[29]  Yaochu Jin,et al.  Multi-Objective Evolutionary Federated Learning , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Tian Li,et al.  Fair Resource Allocation in Federated Learning , 2019, ICLR.

[31]  Davor Svetinovic,et al.  Security and Privacy in Decentralized Energy Trading Through Multi-Signatures, Blockchain and Anonymous Messaging Streams , 2018, IEEE Transactions on Dependable and Secure Computing.

[32]  Yang Song,et al.  Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learning , 2018, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[33]  Jimeng Sun,et al.  Federated Tensor Factorization for Computational Phenotyping , 2017, KDD.

[34]  Peng Xiao,et al.  Averaging Is Probably Not the Optimum Way of Aggregating Parameters in Federated Learning , 2020, Entropy.

[35]  Hongyu Li,et al.  An End-to-End Encrypted Neural Network for Gradient Updates Transmission in Federated Learning , 2019, 2019 Data Compression Conference (DCC).

[36]  Yansheng Wang,et al.  Federated Latent Dirichlet Allocation: A Local Differential Privacy Based Framework , 2020, AAAI.

[37]  Kuo-Yi Lin,et al.  User experience-based product design for smart production to empower industry 4.0 in the glass recycling circular economy , 2018, Comput. Ind. Eng..

[38]  Max A. Viergever,et al.  A deep learning framework for unsupervised affine and deformable image registration , 2018, Medical Image Anal..

[39]  Choong Seon Hong,et al.  Blockchain-based Node-aware Dynamic Weighting Methods for Improving Federated Learning Performance , 2019, 2019 20th Asia-Pacific Network Operations and Management Symposium (APNOMS).

[40]  Prateek Mittal,et al.  Analyzing Federated Learning through an Adversarial Lens , 2018, ICML.

[41]  Qiang Yang,et al.  Federated Machine Learning , 2019, ACM Trans. Intell. Syst. Technol..

[42]  Xu Chen,et al.  In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning , 2018, IEEE Network.

[43]  Lifeng Sun,et al.  Two-Stream Federated Learning: Reduce the Communication Costs , 2018, 2018 IEEE Visual Communications and Image Processing (VCIP).

[44]  Kin K. Leung,et al.  Adaptive Federated Learning in Resource Constrained Edge Computing Systems , 2018, IEEE Journal on Selected Areas in Communications.

[45]  Ahmed Al-Jawad,et al.  A systematic review of the characteristics and validity of monitoring technologies to assess Parkinson’s disease , 2016, Journal of NeuroEngineering and Rehabilitation.

[46]  Tao Xiang,et al.  A training-integrity privacy-preserving federated learning scheme with trusted execution environment , 2020, Inf. Sci..

[47]  Long Hu,et al.  Privacy-aware service placement for mobile edge computing via federated learning , 2019, Inf. Sci..

[48]  Joseph Dureau,et al.  Federated Learning for Keyword Spotting , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[49]  John Edwards.  Medicine on the Move: Wearable devices supply health-care providers with the data and insights necessary to diagnose medical issues and create optimal treatment plans [Special Reports] , 2019, IEEE Signal Processing Magazine.

[50]  Kan Yang,et al.  VerifyNet: Secure and Verifiable Federated Learning , 2020, IEEE Transactions on Information Forensics and Security.

[51]  Ying-Chang Liang,et al.  Incentive Design for Efficient Federated Learning in Mobile Networks: A Contract Theory Approach , 2019, 2019 IEEE VTS Asia Pacific Wireless Communications Symposium (APWCS).

[52]  Tanir Ozcelebi,et al.  Towards federated unsupervised representation learning , 2020, EdgeSys@EuroSys.

[53]  A. Correa,et al.  Association between obesity phenotypes of insulin resistance and risk of type 2 diabetes in African Americans: The Jackson Heart Study , 2019, Journal of clinical & translational endocrinology.

[54]  Mariana Raykova,et al.  Privacy-Preserving Distributed Linear Regression on High-Dimensional Data , 2017, Proc. Priv. Enhancing Technol..

[55]  Dmitriy Dligach,et al.  Two-stage Federated Phenotyping and Patient Representation Learning , 2019, BioNLP@ACL.

[56]  Eryk Dutkiewicz,et al.  Energy Demand Prediction with Federated Learning for Electric Vehicle Networks , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[57]  Krishna K. Venkatasubramanian,et al.  Detecting data manipulation attacks on physiological sensor measurements in wearable medical systems , 2018, EURASIP Journal on Information Security.

[58]  Fei Wang,et al.  Privacy-Preserving Patient Similarity Learning in a Federated Environment: Development and Analysis , 2018, JMIR medical informatics.

[59]  Yasaman Khazaeni,et al.  Bayesian Nonparametric Federated Learning of Neural Networks , 2019, ICML.