Permissioned Blockchain and Deep Reinforcement Learning for Content Caching in Vehicular Edge Computing and Networks

Vehicular Edge Computing (VEC) is a promising paradigm to enable huge amount of multimedia content to be cached in proximity to vehicles. Since vehicles are equipped with a certain amount of caching resource, they can be regarded as edge nodes to expand the caching capacity of the network edge. However, with much sensitive personal information, vehicles may be not willing to cache their content to an untrusted vehicle. Permission blockchain has the potential to address such an issue. In this paper, we utilize permissioned blockchain to design a secure content caching scheme between vehicles. Since high mobility of vehicles makes a dynamic caching environment, we exploit deep reinforcement learning approach to design the content caching scheme. Moreover, we propose a new block verifier selection metric, Proof-of-Utility (PoU), to enable a lightweight permissioned blockchain. Security analysis shows that our proposed blockchain empowered content caching can achieve security and privacy protection. Numerical results based on the Uber dataset indicate the DRL-inspired content caching scheme significantly outperforms two benchmark policies.

[1]  Giuseppe Caire,et al.  Wireless Device-to-Device Caching Networks: Basic Principles and System Performance , 2013, IEEE Journal on Selected Areas in Communications.

[2]  Qian He,et al.  Blockchain and Deep Reinforcement Learning Empowered Intelligent 5G Beyond , 2019, IEEE Network.

[3]  Keke Gai,et al.  Permissioned Blockchain and Edge Computing Empowered Privacy-Preserving Smart Grid Networks , 2019, IEEE Internet of Things Journal.

[4]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[5]  Du Xu,et al.  Joint Load Balancing and Offloading in Vehicular Edge Computing and Networks , 2019, IEEE Internet of Things Journal.

[6]  Alexandros G. Dimakis,et al.  FemtoCaching: Wireless Content Delivery Through Distributed Caching Helpers , 2013, IEEE Transactions on Information Theory.

[7]  Satoshi Nakamoto Bitcoin : A Peer-to-Peer Electronic Cash System , 2009 .

[8]  Yan Zhang,et al.  Cooperative Content Caching in 5G Networks with Mobile Edge Computing , 2018, IEEE Wireless Communications.

[9]  Yan Zhang,et al.  Enabling Localized Peer-to-Peer Electricity Trading Among Plug-in Hybrid Electric Vehicles Using Consortium Blockchains , 2017, IEEE Transactions on Industrial Informatics.

[10]  Zhu Han,et al.  Joint Optimization of Caching, Computing, and Radio Resources for Fog-Enabled IoT Using Natural Actor–Critic Deep Reinforcement Learning , 2019, IEEE Internet of Things Journal.

[11]  Neeraj Kumar,et al.  Blockchain-Based Distributed Framework for Automotive Industry in a Smart City , 2019, IEEE Transactions on Industrial Informatics.

[12]  Yan Zhang,et al.  Artificial Intelligence Empowered Edge Computing and Caching for Internet of Vehicles , 2019, IEEE Wireless Communications.