A Reinforcement Learning and Blockchain-Based Trust Mechanism for Edge Networks

Mobile edge computing (MEC) raises the issue of resisting selfish edge attackers that use less computation resources than promised to process offloading tasks or provide faked computation results. In this paper, we present a blockchain based trust mechanism to help MEC address selfish edge attacks and faked service record attacks. This mechanism evaluates the computational performance of the edge devices and broadcasts such information to the neighboring edge devices and mobile devices. By building a reputation assignment method for the edge devices, the edge reputation system chooses the miner of the blockchain, which applies the joint Proof-of-Work and Proof-of-Stake consensus protocol to append a block recording the new service reputations onto the MEC blockchain. We propose a reinforcement learning (RL) based edge central processing unit (CPU) allocation algorithm without knowing the mobile service generation model and the network model in the dynamic edge computing process and a deep RL version to further improve the computational performance. The security performance is analyzed and the performance bound of the edge utility is provided. Experimental results show that this framework suppresses the selfish edge attacks, decreases the response latency and saves the energy compared with a benchmark MEC scheme.

[1]  Davor Svetinovic,et al.  Security and Privacy in Decentralized Energy Trading Through Multi-Signatures, Blockchain and Anonymous Messaging Streams , 2018, IEEE Transactions on Dependable and Secure Computing.

[2]  Alex Pentland,et al.  Decentralizing Privacy: Using Blockchain to Protect Personal Data , 2015, 2015 IEEE Security and Privacy Workshops.

[3]  Elaine Shi,et al.  Hawk: The Blockchain Model of Cryptography and Privacy-Preserving Smart Contracts , 2016, 2016 IEEE Symposium on Security and Privacy (SP).

[4]  Shengli Xie,et al.  Blockchain for Secure and Efficient Data Sharing in Vehicular Edge Computing and Networks , 2019, IEEE Internet of Things Journal.

[5]  Song Guo,et al.  Achieve Sustainable Ultra-Dense Heterogeneous Networks for 5G , 2017, ArXiv.

[6]  Hong Li,et al.  Blockchain for Large-Scale Internet of Things Data Storage and Protection , 2019, IEEE Transactions on Services Computing.

[7]  Liang Xiao,et al.  Cloud-Based Malware Detection Game for Mobile Devices with Offloading , 2017, IEEE Transactions on Mobile Computing.

[8]  Liang Xiao,et al.  Game theoretic study on blockchain based secure edge networks , 2017, 2017 IEEE/CIC International Conference on Communications in China (ICCC).

[9]  Shaolei Ren,et al.  Online Learning for Offloading and Autoscaling in Energy Harvesting Mobile Edge Computing , 2017, IEEE Transactions on Cognitive Communications and Networking.

[10]  Hong Liu,et al.  Blockchain-Enabled Security in Electric Vehicles Cloud and Edge Computing , 2018, IEEE Network.

[11]  Tony Q. S. Quek,et al.  Offloading in Mobile Edge Computing: Task Allocation and Computational Frequency Scaling , 2017, IEEE Transactions on Communications.

[12]  Björn Scheuermann,et al.  Bitcoin and Beyond: A Technical Survey on Decentralized Digital Currencies , 2016, IEEE Communications Surveys & Tutorials.

[13]  Rong Yu,et al.  Distributed Reputation Management for Secure and Efficient Vehicular Edge Computing and Networks , 2017, IEEE Access.

[14]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[15]  Jian Sun,et al.  Convolutional neural networks at constrained time cost , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Zhu Han,et al.  When Mobile Blockchain Meets Edge Computing , 2017, IEEE Communications Magazine.

[17]  Ruslan Salakhutdinov,et al.  Actor-Mimic: Deep Multitask and Transfer Reinforcement Learning , 2015, ICLR.

[18]  Oscar Novo,et al.  Blockchain Meets IoT: An Architecture for Scalable Access Management in IoT , 2018, IEEE Internet of Things Journal.

[19]  Qinghua Zheng,et al.  Secure Content Delivery With Edge Nodes to Save Caching Resources for Mobile Users in Green Cities , 2018, IEEE Transactions on Industrial Informatics.

[20]  Yongqiang Lyu,et al.  Hyperconnected Network: A Decentralized Trusted Computing and Networking Paradigm , 2018, IEEE Network.

[21]  Haiyun Luo,et al.  Energy-Optimal Mobile Cloud Computing under Stochastic Wireless Channel , 2013, IEEE Transactions on Wireless Communications.

[22]  Victor C. M. Leung,et al.  Computation Offloading and Content Caching in Wireless Blockchain Networks With Mobile Edge Computing , 2018, IEEE Transactions on Vehicular Technology.

[23]  Minyi Guo,et al.  Making Big Data Open in Edges: A Resource-Efficient Blockchain-Based Approach , 2019, IEEE Transactions on Parallel and Distributed Systems.

[24]  K. B. Letaief,et al.  A Survey on Mobile Edge Computing: The Communication Perspective , 2017, IEEE Communications Surveys & Tutorials.

[25]  Dusit Niyato,et al.  Optimal Auction for Edge Computing Resource Management in Mobile Blockchain Networks: A Deep Learning Approach , 2017, 2018 IEEE International Conference on Communications (ICC).

[26]  Yiwei Thomas Hou,et al.  Proximity-Based Security Techniques for Mobile Users in Wireless Networks , 2013, IEEE Transactions on Information Forensics and Security.

[27]  Jiannong Cao,et al.  AppBooster: Boosting the Performance of Interactive Mobile Applications with Computation Offloading and Parameter Tuning , 2017, IEEE Transactions on Parallel and Distributed Systems.

[28]  H. Vincent Poor,et al.  Mobile offloading game against smart attacks , 2016, 2016 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[29]  Yan Zhang,et al.  Enabling Localized Peer-to-Peer Electricity Trading Among Plug-in Hybrid Electric Vehicles Using Consortium Blockchains , 2017, IEEE Transactions on Industrial Informatics.

[30]  Victor C. M. Leung,et al.  Distributed Resource Allocation in Blockchain-Based Video Streaming Systems With Mobile Edge Computing , 2019, IEEE Transactions on Wireless Communications.

[31]  Khashayar Kotobi,et al.  Secure Blockchains for Dynamic Spectrum Access: A Decentralized Database in Moving Cognitive Radio Networks Enhances Security and User Access , 2018, IEEE Vehicular Technology Magazine.

[32]  Liang Xiao,et al.  Energy Trading Game for Microgrids Using Reinforcement Learning , 2017, GAMENETS.

[33]  Hyundong Shin,et al.  Learning for Computation Offloading in Mobile Edge Computing , 2018, IEEE Transactions on Communications.

[34]  Victor C. M. Leung,et al.  Blockchain-Based Decentralized Trust Management in Vehicular Networks , 2019, IEEE Internet of Things Journal.

[35]  Zhu Han,et al.  Optimal Pricing-Based Edge Computing Resource Management in Mobile Blockchain , 2017, 2018 IEEE International Conference on Communications (ICC).