Blockchain-Incentivized D2D and Mobile Edge Caching: A Deep Reinforcement Learning Approach

D2D caching assists mobile edge caching in offloading inter-domain traffic by sharing cached items with nearby users, while its performance relies heavily on caching nodes' sharing willingness. In this article, a Blockchain-based CDM is proposed as an incentive mechanism for the distributed caching system. Under given incentive mechanisms, both D2D and mobile edge caching nodes' willingness is guaranteed by satisfying their expected reward for cache sharing. Besides, for the distributed CDM, content delivery related transactions are executed by smart contracts. To achieve consensus on the transactions and prevent frauds, a consensus protocol among the SCENE is necessary. The pPBFT protocol is proposed to minimize the latency of reaching consensus while guaranteeing its confidence level. We build the model of cache sharing and transaction execution consensus, and we further formulate cache placement and SCENE selection as Markov Decision Process problems. Considering the complexity and dynamics of the problems, a deep reinforcement learning approach is adopted to solve the problems. Simulation results show that, compared to conventional solutions, the proposed schemes achieve efficient traffic offloading, and significantly improve the transaction execution consensus speed.

[1]  Zhu Han,et al.  Trust-Based Social Networks with Computing, Caching and Communications: A Deep Reinforcement Learning Approach , 2020, IEEE Transactions on Network Science and Engineering.

[2]  Miguel Castro,et al.  Practical byzantine fault tolerance and proactive recovery , 2002, TOCS.

[3]  Mauro Conti,et al.  A Survey on Security and Privacy Issues of Bitcoin , 2017, IEEE Communications Surveys & Tutorials.

[4]  Richard Evans,et al.  Deep Reinforcement Learning in Large Discrete Action Spaces , 2015, 1512.07679.

[5]  Zhu Han,et al.  Caching based socially-aware D2D communications in wireless content delivery networks: a hypergraph framework , 2016, IEEE Wireless Communications.

[6]  Yanhua Zhang,et al.  Virtualization for Distributed Ledger Technology (vDLT) , 2018, IEEE Access.

[7]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[8]  Mohsen Guizani,et al.  Caching in Information-Centric Networking: Strategies, Challenges, and Future Research Directions , 2018, IEEE Communications Surveys & Tutorials.

[9]  Dusit Niyato,et al.  Decentralized Caching for Content Delivery Based on Blockchain: A Game Theoretic Perspective , 2018, 2018 IEEE International Conference on Communications (ICC).

[10]  Xiaodong Lin,et al.  Understanding Ethereum via Graph Analysis , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[11]  F. Richard Yu,et al.  Joint Resource Allocation for Software Defined Networking, Caching and Computing , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[12]  F. Richard Yu,et al.  Integrated Blockchain and Edge Computing Systems: A Survey, Some Research Issues and Challenges , 2019, IEEE Communications Surveys & Tutorials.

[13]  Jiangzhou Wang,et al.  On Consideration of Content Preference and Sharing Willingness in D2D Assisted Offloading , 2017, IEEE Journal on Selected Areas in Communications.