In Proof-of-Work (PoW) blockchain systems, miners can select the pool to join for maximizing their revenues, leading to the mining pool selection problem. A pool can infiltrate its mining power into other pools for only obtaining additional revenues without substantially contributing to their mining work. This is called Block WithHolding (BWH) attack and significantly affects the pool selection of miners. We therefore investigate the mining pool selection issue under the BWH attack in this paper. Previous studies rely on an arguable and impractical assumption that miners can observe the attack to calculate their payoffs. This paper however focuses on unobservable BWH attack and applies reinforcement learning (RL) techniques to analyze the intelligent pool selection of miners. We adopt three typical RL models, i.e., Q-Learning (QL), Deep Q Network (DQN) and Advantage Actor-Critic (A2C) to dynamically learn the optimal pool selection policies of an intelligent miner, and use a discrete-event simulator to measure the reward of the miner. Simulation results are also provided to demonstrate the learning performances of the three models.
[1]
Ittay Eyal,et al.
The Miner's Dilemma
,
2014,
2015 IEEE Symposium on Security and Privacy.
[2]
Dusit Niyato,et al.
Evolutionary Game for Mining Pool Selection in Blockchain Networks
,
2017,
IEEE Wireless Communications Letters.
[3]
Jeffrey S. Rosenschein,et al.
Bitcoin Mining Pools: A Cooperative Game Theoretic Analysis
,
2015,
AAMAS.
[4]
Seonggeun Kim,et al.
Mining Pool Manipulation in Blockchain Network Over Evolutionary Block Withholding Attack
,
2019,
IEEE Access.
[5]
Sam M. Werner,et al.
PoolSim: A Discrete-Event Mining Pool Simulation Framework
,
2019,
MARBLE.
[6]
Kasahara Shoji,et al.
Mining Pool Selection Problem in the Presence of Block Withholding Attack
,
2020
.
[7]
Aggelos Kiayias,et al.
The Bitcoin Backbone Protocol: Analysis and Applications
,
2015,
EUROCRYPT.
[8]
Aggelos Kiayias,et al.
Reward Sharing Schemes for Stake Pools
,
2018,
2020 IEEE European Symposium on Security and Privacy (EuroS&P).