Interactive Artificial Intelligence Meets Game Theory in Next-Generation Communication Networks

Next-generation communication networks can provide high capacity, low latency, and massive connections; however, they introduce novel challenges of management complexity, and traditional mathematical methods cannot well characterize the rational behavior of users. In this article, we pay attention to the methods of artificial intelligence (AI) and game theory. We first review the applications of machine learning (ML) and game theory models in wireless communications and summarize their advantages and disadvantages. After surveying the state of the art, in this article we propose a novel framework combining ML and game theory, which explores and exploits the benefits of the two disciplines. Finally, we apply our novel framework to solve the network selection problem in a 5G ultra-dense and heterogeneous network. Simulation results confirm the advantage of our presented framework on reducing the average delay of users.

[1]  Mohamed A. Hawas.  Are We Intentionally Limiting Urban Planning and Intelligence? A Causal Evaluative Review and Methodical Redirection for Intelligence Systems , 2017, IEEE Access.

[2]  Tuomas Sandholm,et al.  Safe and Nested Subgame Solving for Imperfect-Information Games , 2017, NIPS.

[3]  Shi Jin,et al.  Channel Estimation for Massive MIMO Using Gaussian-Mixture Bayesian Learning , 2015, IEEE Transactions on Wireless Communications.

[4]  Michael P. Wellman,et al.  Multiagent Reinforcement Learning: Theoretical Framework and an Algorithm , 1998, ICML.

[5]  Zhu Han,et al.  Machine Learning Paradigms for Next-Generation Wireless Networks , 2017, IEEE Wireless Communications.

[6]  Setareh Maghsudi,et al.  Channel Selection for Network-Assisted D2D Communication via No-Regret Bandit Learning With Calibrated Forecasting , 2014, IEEE Transactions on Wireless Communications.

[7]  Bin Li,et al.  Learning-Based Spectrum Sharing and Spatial Reuse in mm-Wave Ultradense Networks , 2018, IEEE Transactions on Vehicular Technology.

[8]  David Silver,et al.  Deep Reinforcement Learning from Self-Play in Imperfect-Information Games , 2016, ArXiv.

[9]  Michael L. Littman,et al.  Markov Games as a Framework for Multi-Agent Reinforcement Learning , 1994, ICML.

[10]  Xiaofeng Wang,et al.  Reinforcement Learning to Play an Optimal Nash Equilibrium in Team Markov Games , 2002, NIPS.

[11]  H. Harai,et al.  Optical and wireless hybrid access networks: Design and optimization , 2012, IEEE/OSA Journal of Optical Communications and Networking.

[12]  Zhu Han,et al.  Coalitional Games for Resource Allocation in the Device-to-Device Uplink Underlaying Cellular Networks , 2014, IEEE Transactions on Wireless Communications.

[13]  Jie Yang,et al.  Data-Driven Deep Learning for Automatic Modulation Recognition in Cognitive Radios , 2019, IEEE Transactions on Vehicular Technology.

[14]  Hamed Kebriaei,et al.  Learning RAT Selection Game in 5G Heterogeneous Networks , 2016, IEEE Wireless Communications Letters.

[15]  Di He,et al.  A Game-Theoretic Machine Learning Approach for Revenue Maximization in Sponsored Search , 2013, IJCAI.

[16]  Zhu Han,et al.  Coalitional game theory for communication networks , 2009, IEEE Signal Processing Magazine.

[17]  David Silver,et al.  Fictitious Self-Play in Extensive-Form Games , 2015, ICML.