Integration of blockchain and federated learning for Internet of Things: Recent advances and future challenges

Abstract The role of the Internet of Things (IoT) in the revolutionized society cannot be overlooked. The IoT can leverage advanced machine learning (ML) algorithms for its applications. However, given the fact of massive data, which is stored at a central cloud server, adopting centralized machine learning algorithms is not a viable option due to immense computation cost and privacy leakage issues. Given such conditions, blockchain can be leveraged to enhance the privacy of IoT networks by making them decentralized without any central authority. Nevertheless, the sensitive and massive data that is stored in distributive fashion, leveraged it for application purpose, is still a challenging task. To overcome this challenging task, federated learning (FL), which is a new breed of ML is the most promising solution that brings learning to the end devices without sharing the private data to the central server. In the FL mechanism, the central server act as an orchestrator to start the FL learning process, and only model parameters' updates are shared between end devices and the central orchestrator. Although FL can provide better privacy and data management, it is still in the development phase and has not been adopted by various communities due to its unknown privacy issues. In this paper first, we present the notion of blockchain and its application in IoT systems. Then we describe the privacy issues related to the implementation of blockchain in IoT and present privacy preservation techniques to cope with the privacy issues. Second, we introduce the FL application in IoT systems, devise a taxonomy, and present privacy threats in FL. Afterward, we present IoT-based use cases on envisioned dispersed federated learning and introduce blockchain-based traceability functions to improve privacy. Finally, open research gaps are addressed for future work.

[1]  Yubin Xia,et al.  ShadowEth: Private Smart Contract on Public Blockchain , 2018, Journal of Computer Science and Technology.

[2]  Dan Alistarh A Brief Tutorial on Distributed and Concurrent Machine Learning , 2018, PODC.

[3]  Deepak Puthal,et al.  Everything You Wanted to Know About the Blockchain: Its Promise, Components, Processes, and Problems , 2018, IEEE Consumer Electronics Magazine.

[4]  Davor Svetinovic,et al.  Security and Privacy in Decentralized Energy Trading Through Multi-Signatures, Blockchain and Anonymous Messaging Streams , 2018, IEEE Transactions on Dependable and Secure Computing.

[5]  Sarvar Patel,et al.  Practical Secure Aggregation for Federated Learning on User-Held Data , 2016, ArXiv.

[6]  Katharina Krombholz,et al.  "If HTTPS Were Secure, I Wouldn't Need 2FA" - End User and Administrator Mental Models of HTTPS , 2019, 2019 IEEE Symposium on Security and Privacy (SP).

[7]  Mohammed Samaka,et al.  Security Services Using Blockchains: A State of the Art Survey , 2018, IEEE Communications Surveys & Tutorials.

[8]  Zhu Han,et al.  Ambient Backscatter Assisted Wireless Powered Communications , 2018, IEEE Wireless Communications.

[9]  Kin K. Leung,et al.  Adaptive Federated Learning in Resource Constrained Edge Computing Systems , 2018, IEEE Journal on Selected Areas in Communications.

[10]  Yasaman Khazaeni,et al.  Federated Learning with Matched Averaging , 2020, ICLR.

[11]  Ramiro Gonçalves,et al.  Systematic Review of the Literature, Research on Blockchain Technology as Support to the Trust Model Proposed Applied to Smart Places , 2018, WorldCIST.

[12]  Victor C. M. Leung,et al.  Blockchain-Based Decentralized Trust Management in Vehicular Networks , 2019, IEEE Internet of Things Journal.

[13]  Wei Zhang,et al.  Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent , 2017, NIPS.

[14]  Wenqi Wei,et al.  Demystifying Membership Inference Attacks in Machine Learning as a Service , 2019, IEEE Transactions on Services Computing.

[15]  Mansoor Ali,et al.  Vulnerability Assessment of 6G-Enabled Smart Grid Cyber–Physical Systems , 2021, IEEE Internet of Things Journal.

[16]  Tim Verbelen,et al.  A Survey on Distributed Machine Learning , 2019, ACM Comput. Surv..

[17]  Yun Peng,et al.  Lightweight Backup and Efficient Recovery Scheme for Health Blockchain Keys , 2017, 2017 IEEE 13th International Symposium on Autonomous Decentralized System (ISADS).

[18]  Han Yu,et al.  Threats to Federated Learning: A Survey , 2020, ArXiv.

[19]  Xing Li,et al.  Secure Data Aggregation with Fully Homomorphic Encryption in Large-Scale Wireless Sensor Networks , 2015, Sensors.

[20]  Li Da Xu,et al.  Industry 4.0: state of the art and future trends , 2018, Int. J. Prod. Res..

[21]  Peter Richtárik,et al.  Federated Learning: Strategies for Improving Communication Efficiency , 2016, ArXiv.

[22]  Xu Chen,et al.  In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning , 2018, IEEE Network.

[23]  Xin Qin,et al.  FedHealth: A Federated Transfer Learning Framework for Wearable Healthcare , 2019, IEEE Intelligent Systems.

[24]  Kai Chen,et al.  Multitier Fog Computing With Large-Scale IoT Data Analytics for Smart Cities , 2018, IEEE Internet of Things Journal.

[25]  Anit Kumar Sahu,et al.  Federated Optimization in Heterogeneous Networks , 2018, MLSys.

[26]  Jimeng Sun,et al.  Federated Tensor Factorization for Computational Phenotyping , 2017, KDD.

[27]  Ming Liu,et al.  Lifelong Federated Reinforcement Learning: A Learning Architecture for Navigation in Cloud Robotic Systems , 2019, IEEE Robotics and Automation Letters.

[28]  Anit Kumar Sahu,et al.  Federated Learning: Challenges, Methods, and Future Directions , 2019, IEEE Signal Processing Magazine.

[29]  Kevin Ashton,et al.  That ‘Internet of Things’ Thing , 1999 .

[30]  H. Vincent Poor,et al.  Wireless Communications for Collaborative Federated Learning , 2020, IEEE Communications Magazine.

[31]  Walid Saad,et al.  Brainstorming Generative Adversarial Networks (BGANs): Towards Multi-Agent Generative Models with Distributed Private Datasets , 2020, ArXiv.

[32]  Tiago M. Fernández-Caramés,et al.  A Review on the Use of Blockchain for the Internet of Things , 2018, IEEE Access.

[33]  Mohsen Guizani,et al.  Reliable Federated Learning for Mobile Networks , 2019, IEEE Wireless Communications.

[34]  Choong Seon Hong,et al.  A Crowdsourcing Framework for On-Device Federated Learning , 2020, IEEE Transactions on Wireless Communications.

[35]  Yang Song,et al.  Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learning , 2018, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[36]  Walid Saad,et al.  Federated Learning for Internet of Things: Recent Advances, Taxonomy, and Open Challenges , 2020, IEEE Communications Surveys & Tutorials.

[37]  Zibin Zheng,et al.  Blockchain for Internet of Things: A Survey , 2019, IEEE Internet of Things Journal.

[38]  Bingsheng He,et al.  A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection , 2019, IEEE Transactions on Knowledge and Data Engineering.

[39]  Paul Schott Reference Guide to Anti-Money Laundering and Combating the Financing of Terrorism , 2006 .

[40]  Sarvar Patel,et al.  Practical Secure Aggregation for Privacy-Preserving Machine Learning , 2017, IACR Cryptol. ePrint Arch..

[41]  Yan Zhang,et al.  Federated Learning for Data Privacy Preservation in Vehicular Cyber-Physical Systems , 2020, IEEE Network.

[42]  Walid Saad,et al.  Wireless Communications for Collaborative Federated Learning , 2020, IEEE Communications Magazine.

[43]  Wei Yu,et al.  A Survey of Blockchain: Techniques, Applications, and Challenges , 2018, 2018 27th International Conference on Computer Communication and Networks (ICCCN).

[44]  Praneeth Babu Marella,et al.  Ancile: Privacy-Preserving Framework for Access Control and Interoperability of Electronic Health Records Using Blockchain Technology , 2018 .

[45]  Stefan Savage,et al.  A fistful of bitcoins: characterizing payments among men with no names , 2013, Internet Measurement Conference.

[46]  Adi Shamir,et al.  Quantitative Analysis of the Full Bitcoin Transaction Graph , 2013, Financial Cryptography.

[47]  Choong Seon Hong,et al.  Federated Learning Based Mobile Edge Computing for Augmented Reality Applications , 2020, 2020 International Conference on Computing, Networking and Communications (ICNC).

[48]  Gang Chen,et al.  Untangling Blockchain: A Data Processing View of Blockchain Systems , 2017, IEEE Transactions on Knowledge and Data Engineering.

[49]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[50]  Zhu Han,et al.  Auction based Incentive Design for Efficient Federated Learning in Cellular Wireless Networks , 2020, 2020 IEEE Wireless Communications and Networking Conference (WCNC).

[51]  Xiaodong Lin,et al.  Efficient and Privacy-Preserving Carpooling Using Blockchain-Assisted Vehicular Fog Computing , 2019, IEEE Internet of Things Journal.

[52]  Elaine Shi,et al.  Hawk: The Blockchain Model of Cryptography and Privacy-Preserving Smart Contracts , 2016, 2016 IEEE Symposium on Security and Privacy (SP).

[53]  Manuel Díaz,et al.  On blockchain and its integration with IoT. Challenges and opportunities , 2018, Future Gener. Comput. Syst..

[54]  Gang Qu,et al.  BARS: A Blockchain-Based Anonymous Reputation System for Trust Management in VANETs , 2018, 2018 17th IEEE International Conference On Trust, Security And Privacy In Computing And Communications/ 12th IEEE International Conference On Big Data Science And Engineering (TrustCom/BigDataSE).

[55]  Chun-Wei Tsai,et al.  Toward Blockchains for Health-Care Systems: Applying the Bilinear Pairing Technology to Ensure Privacy Protection and Accuracy in Data Sharing , 2018, IEEE Consumer Electronics Magazine.

[56]  Matthew Green,et al.  Zerocoin: Anonymous Distributed E-Cash from Bitcoin , 2013, 2013 IEEE Symposium on Security and Privacy.

[57]  Marc Pilkington,et al.  Blockchain Technology: Principles and Applications , 2015 .

[58]  Ali Dehghantanha,et al.  Cybersecurity in Smart Farming: Canada Market Research , 2021, ArXiv.

[59]  Ying-Chang Liang,et al.  Federated Learning in Mobile Edge Networks: A Comprehensive Survey , 2020, IEEE Communications Surveys & Tutorials.

[60]  A. Anonymous,et al.  Consumer Data Privacy in a Networked World: A Framework for Protecting Privacy and Promoting Innovation in the Global Digital Economy , 2013, J. Priv. Confidentiality.

[61]  Prateek Mittal,et al.  Graph Data Anonymization, De-Anonymization Attacks, and De-Anonymizability Quantification: A Survey , 2017, IEEE Communications Surveys & Tutorials.

[62]  Blaise Agüera y Arcas,et al.  Federated Learning of Deep Networks using Model Averaging , 2016, ArXiv.

[63]  Marc Tommasi,et al.  Decentralized Collaborative Learning of Personalized Models over Networks , 2016, AISTATS.

[64]  Sebastian Zander,et al.  Emerging and Unconventional: New Attacks and Innovative Detection Techniques , 2018, Secur. Commun. Networks.

[65]  Mauro Conti,et al.  A Survey on Security and Privacy Issues of Bitcoin , 2017, IEEE Communications Surveys & Tutorials.

[66]  Jun Zhang,et al.  Edge-Assisted Hierarchical Federated Learning with Non-IID Data , 2019, ArXiv.

[67]  Mohsen Guizani,et al.  Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications , 2015, IEEE Communications Surveys & Tutorials.

[68]  Jeremy Clark,et al.  Mixcoin: Anonymity for Bitcoin with Accountable Mixes , 2014, Financial Cryptography.

[69]  Stephen Hailes,et al.  Security of smart manufacturing systems , 2018 .

[70]  Oscar Novo,et al.  Blockchain Meets IoT: An Architecture for Scalable Access Management in IoT , 2018, IEEE Internet of Things Journal.

[71]  Shengli Xie,et al.  Incentive Mechanism for Reliable Federated Learning: A Joint Optimization Approach to Combining Reputation and Contract Theory , 2019, IEEE Internet of Things Journal.

[72]  Tao Wang,et al.  Privacy Preservation in Big Data From the Communication Perspective—A Survey , 2019, IEEE Communications Surveys & Tutorials.

[73]  Shiho Kim,et al.  Chapter Ten - Integration of IoT with blockchain and homomorphic encryption: Challenging issues and opportunities , 2019, Adv. Comput..

[74]  Seong-Lyun Kim,et al.  Blockchained On-Device Federated Learning , 2018, IEEE Communications Letters.

[75]  Pin Lv,et al.  BeeKeeper: A Blockchain-Based IoT System With Secure Storage and Homomorphic Computation , 2018, IEEE Access.

[76]  Mats Jirstrand,et al.  A Performance Evaluation of Federated Learning Algorithms , 2018, DIDL@Middleware.

[77]  Eli Ben-Sasson,et al.  Zerocash: Decentralized Anonymous Payments from Bitcoin , 2014, 2014 IEEE Symposium on Security and Privacy.

[78]  Yunfeng Liu,et al.  Federated Object Detection: Optimizing Object Detection Model with Federated Learning , 2019, ICVISP.

[79]  Lingjuan Lyu,et al.  Threats to Federated Learning , 2020, Federated Learning.

[80]  Pedro Moreno-Sanchez,et al.  CoinShuffle: Practical Decentralized Coin Mixing for Bitcoin , 2014, ESORICS.

[81]  Mohsen Guizani,et al.  Applications of blockchain in unmanned aerial vehicles: A review , 2020, Veh. Commun..

[82]  Ghassan O. Karame,et al.  Evaluating User Privacy in Bitcoin , 2013, Financial Cryptography.

[83]  Mark Campbell,et al.  Smart Edge: The Effects of Shifting the Center of Data Gravity Out of the Cloud , 2019, Computer.

[84]  Jinjun Chen,et al.  Privacy preservation in blockchain based IoT systems: Integration issues, prospects, challenges, and future research directions , 2019, Future Gener. Comput. Syst..

[85]  Jad Wahab Privacy in Blockchain Systems , 2018, ArXiv.

[86]  Miao Pan,et al.  Federated Learning in Vehicular Edge Computing: A Selective Model Aggregation Approach , 2020, IEEE Access.

[87]  Yong Xiang,et al.  Decentralized Privacy Using Blockchain-Enabled Federated Learning in Fog Computing , 2020, IEEE Internet of Things Journal.

[88]  Xiangliang Zhang,et al.  CreditCoin: A Privacy-Preserving Blockchain-Based Incentive Announcement Network for Communications of Smart Vehicles , 2018, IEEE Transactions on Intelligent Transportation Systems.

[89]  Walid Saad,et al.  Dispersed Federated Learning: Vision, Taxonomy, and Future Directions , 2020, IEEE Wireless Communications.

[90]  Xiaojiang Du,et al.  Consortium Blockchain-Based Malware Detection in Mobile Devices , 2018, IEEE Access.