Blockchain-Empowered Federated Learning Approach for an Intelligent and Reliable D2D Caching Scheme

Cache-enabled device-to-device (D2D) communication is a potential approach to tackle the resource shortage problem. However, public concerns of data privacy and system security still remain, which thus arises an urgent need for a reliable caching scheme. Fortunately, federated learning (FL) with a distributed paradigm provides an effective way to privacy issue by training a high-quality global model without any raw data exchanges. Besides privacy issue, blockchain can be further introduced into FL framework to resist the malicious attacks occurred in D2D caching networks. In this study, we propose a double-layer blockchain-based deep reinforcement FL (BDRFL) scheme to ensure privacy-preserved and caching-efficient D2D networks. In BDRFL, a double-layer blockchain is utilized to further enhance data security. Simulation results first verify the convergence of BDRFL-based algorithm, and then demonstrate that the download latency of the BDRFL-based caching scheme can be significantly reduced under different types of attacks when compared with some existing caching policies.

[1]  Lei Zhang,et al.  Blockchain-Enabled Wireless Internet of Things: Performance Analysis and Optimal Communication Node Deployment , 2019, IEEE Internet of Things Journal.

[2]  Jiawei Han,et al.  A Distributed Game Methodology for Crowdsensing in Uncertain Wireless Scenario , 2020, IEEE Transactions on Mobile Computing.

[3]  Paulo Valente Klaine,et al.  Efficient Handover Mechanism for Radio Access Network Slicing by Exploiting Distributed Learning , 2020, IEEE Transactions on Network and Service Management.

[4]  Naveen Kumar,et al.  A Novel Distributed Q-Learning Based Resource Reservation Framework for Facilitating D2D Content Access Requests in LTE-A Networks , 2018, IEEE Transactions on Network and Service Management.

[5]  Zheng Chen,et al.  Probabilistic Caching in Wireless D2D Networks: Cache Hit Optimal Versus Throughput Optimal , 2016, IEEE Communications Letters.

[6]  Miguel Oom Temudo de Castro,et al.  Practical Byzantine fault tolerance , 1999, OSDI '99.

[7]  Gang Feng,et al.  Multi-Agent Reinforcement Learning for Efficient Content Caching in Mobile D2D Networks , 2019, IEEE Transactions on Wireless Communications.

[8]  Mehdi Bennis,et al.  Inter-Cluster Cooperation for Wireless D2D Caching Networks , 2018, IEEE Transactions on Wireless Communications.

[9]  Tarik Taleb,et al.  Edge Caching Replacement Optimization for D2D Wireless Networks via Weighted Distributed DQN , 2020, 2020 IEEE Wireless Communications and Networking Conference (WCNC).

[10]  John K. Ousterhout,et al.  In Search of an Understandable Consensus Algorithm , 2014, USENIX ATC.

[11]  Zhu Han,et al.  Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks , 2020, IEEE Internet of Things Journal.

[12]  Weihua Zhuang,et al.  Learning-Based Computing Task Offloading for Autonomous Driving: A Load Balancing Perspective , 2021, ICC 2021 - IEEE International Conference on Communications.

[13]  Weihua Zhuang,et al.  SDN/NFV-Empowered Future IoV With Enhanced Communication, Computing, and Caching , 2020, Proceedings of the IEEE.

[14]  Long Zhang,et al.  Direct Acyclic Graph based Blockchain for Internet of Things: Performance and Security Analysis , 2019, ArXiv.

[15]  Meixia Tao,et al.  Caching incentive design in wireless D2D networks: A Stackelberg game approach , 2016, 2016 IEEE International Conference on Communications (ICC).

[16]  Cong Xiong,et al.  Mode Switching for Energy-Efficient Device-to-Device Communications in Cellular Networks , 2015, IEEE Transactions on Wireless Communications.

[17]  Mugen Peng,et al.  Performance analysis and comparison of PoW, PoS and DAG based blockchains , 2020, Digit. Commun. Networks.

[18]  Shahid Mumtaz,et al.  When Internet of Things Meets Blockchain: Challenges in Distributed Consensus , 2019, IEEE Network.

[19]  Ran Zhang,et al.  Blockchain-Incentivized D2D and Mobile Edge Caching: A Deep Reinforcement Learning Approach , 2020, IEEE Network.

[20]  David Silver,et al.  Deep Reinforcement Learning with Double Q-Learning , 2015, AAAI.

[21]  Chenyang Yang,et al.  Caching Policy for Cache-Enabled D2D Communications by Learning User Preference , 2017, IEEE Transactions on Communications.

[22]  Geoffrey Ye Li,et al.  Device-to-Device Communications Underlaying Cellular Networks , 2013, IEEE Transactions on Communications.

[23]  F. Richard Yu,et al.  Deep Reinforcement Learning (DRL)-Based Device-to-Device (D2D) Caching With Blockchain and Mobile Edge Computing , 2020, IEEE Transactions on Wireless Communications.

[24]  Wei Cao,et al.  Intelligent Offloading in Multi-Access Edge Computing: A State-of-the-Art Review and Framework , 2019, IEEE Communications Magazine.

[25]  Giuseppe Caire,et al.  Fundamental Limits of Caching in Wireless D2D Networks , 2014, IEEE Transactions on Information Theory.

[26]  Yan Zhang,et al.  Blockchain and Federated Learning for Privacy-Preserved Data Sharing in Industrial IoT , 2020, IEEE Transactions on Industrial Informatics.