Artificial Intelligence Empowered Power Allocation for Smart Railway

Smart railway is in the process of vigorous development based on the advancement of numerous emerging and advanced techniques, such as artificial intelligence and big data. However, a smart railway network is exceedingly time-varying and complicated, which presents great challenges to power allocation. Deep reinforcement learning is capable of effectually improving the intelligence as well as cognition of high-speed railway network, which helps to optimize the power allocation problems with both time-varying and complicated characteristics. In this article, we first provide an overview of the existing power allocation methods, including advantages, disadvantages, and complexity, as well as characteristics. Then we investigate an innovative power allocation algorithm based on multi-agent deep recurrent deterministic policy gradient (MADRDPG), which is capable of learning power decisions from past experience instead of an accurate mathematical model. Finally, numerical results indicate that the performance of the MADRDPG-based method significantly outperforms existing state-of-the-art methods in terms of spectrum efficiency and execution latency.

[1]  Wei Yu,et al.  Fractional Programming for Communication Systems—Part I: Power Control and Beamforming , 2018, IEEE Transactions on Signal Processing.

[2]  Yi Wu,et al.  Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments , 2017, NIPS.

[3]  Dongning Guo,et al.  Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks , 2018, IEEE Journal on Selected Areas in Communications.

[4]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Sen Wang,et al.  Achieving High Spectrum Efficiency on High Speed Train for 5G New Radio and Beyond , 2019, IEEE Wireless Communications.

[6]  Jianpeng Xu,et al.  When High-Speed Railway Networks Meet Multipath TCP: Supporting Dependable Communications , 2020, IEEE Wireless Communications Letters.

[7]  Ohyun Jo,et al.  Intelligent Resource Allocation in Wireless Communications Systems , 2020, IEEE Communications Magazine.

[8]  Haipeng Yao,et al.  The Next Generation Heterogeneous Satellite Communication Networks: Integration of Resource Management and Deep Reinforcement Learning , 2020, IEEE Wireless Communications.

[9]  Bo Ai,et al.  Energy-Efficient Power Control of Train–Ground mmWave Communication for High-Speed Trains , 2019, IEEE Transactions on Vehicular Technology.

[10]  Markus Rupp,et al.  5G Key Technologies for Smart Railways , 2020, Proceedings of the IEEE.

[11]  Ming Cheng,et al.  A Fast Beam Searching Scheme in mmWave Communications for High-Speed Trains , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[12]  Geoffrey Ye Li,et al.  Spectrum Sharing in Vehicular Networks Based on Multi-Agent Reinforcement Learning , 2019, IEEE Journal on Selected Areas in Communications.

[13]  Bo Ai,et al.  AI-Enabled Sub-6-GHz and mm-Wave Hybrid Communications: Considerations for Use With Future HSR Wireless Systems , 2020, IEEE Vehicular Technology Magazine.

[14]  George K. Karagiannidis,et al.  Artificial Intelligence-Based Resource Allocation in Ultradense Networks: Applying Event-Triggered Q-Learning Algorithms , 2019, IEEE Vehicular Technology Magazine.