An Asymmetric Evolutionary Bayesian Coalition Formation Game for Distributed Resource Sharing in a Multi-Cell Device-to-Device Enabled Cellular Network

We present a novel game, called evolutionary Bayesian coalition formation game, to model and analyze the problem of distributed resource sharing in a multi-cell device-to-device (D2D) enabled cellular network where the rationality of the players, i.e., device pairs, is bounded, e.g., due to limited information. Each player can make its decision on the channel to access with and without coordination. In the former case, the player works in D2D mode. In the latter case, the player forms a coalition with some other players and they connect to one base station in cellular mode. In this case, the player realizes its action after observing the actions of other players. Unlike classical coalition formation games where the player decides on its coalition to form by estimating its payoff, in the proposed game, the player forms a coalition and selects an action based on its current population state which is updated using a simple and scalable learning algorithm. We prove that the evolutionary coalition formation process converges to the unique equilibrium that induces a stable coalitional agreement. The proposed process is applied to a long-term evolution-advanced network where it shows a superior performance compared with other baseline resource sharing strategies.

[1]  Alia Asheralieva,et al.  Bayesian Reinforcement Learning-Based Coalition Formation for Distributed Resource Sharing by Device-to-Device Users in Heterogeneous Cellular Networks , 2017, IEEE Transactions on Wireless Communications.

[2]  William H. Sandholm,et al.  Population Games And Evolutionary Dynamics , 2010, Economic learning and social evolution.

[3]  Yoshikazu Miyanaga,et al.  Dynamic Resource Allocation with Integrated Reinforcement Learning for a D2D-Enabled LTE-A Network with Access to Unlicensed Band , 2016, Mob. Inf. Syst..

[4]  Yoshikazu Miyanaga,et al.  Optimal Contract Design for Joint User Association and Intercell Interference Mitigation in Heterogeneous LTE-A Networks With Asymmetric Information , 2017, IEEE Transactions on Vehicular Technology.

[5]  Walid Saad,et al.  Stochastic Coalitional Games for Cooperative Random Access in M2M Communications , 2017, IEEE Transactions on Wireless Communications.

[6]  Miyanaga Yoshikazu,et al.  Multi-agent Q-learning for autonomous D2D communication , 2016 .

[7]  Daesik Hong,et al.  Adaptive Mode Selection in D2D Communications Considering the Bursty Traffic Model , 2016, IEEE Communications Letters.

[8]  Ekram Hossain,et al.  1 Distributed Resource Allocation in 5 G Cellular Networks , 2015 .

[9]  J. Hofbauer,et al.  Evolutionary game dynamics , 2011 .

[10]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[11]  Xiaodong Ji,et al.  Resource Allocation in Cloud Radio Access Networks With Device-to-Device Communications , 2017, IEEE Access.

[12]  Zhu Han,et al.  Game-theoretic resource allocation methods for device-to-device communication , 2014, IEEE Wireless Communications.

[13]  Christos H. Papadimitriou,et al.  Worst-case equilibria , 1999 .

[14]  Halim Yanikomeroglu,et al.  Interference-Aware Energy-Efficient Resource Allocation for OFDMA-Based Heterogeneous Networks With Incomplete Channel State Information , 2015, IEEE Transactions on Vehicular Technology.

[15]  Yoshikazu Miyanaga,et al.  An Autonomous Learning-Based Algorithm for Joint Channel and Power Level Selection by D2D Pairs in Heterogeneous Cellular Networks , 2016, IEEE Transactions on Communications.

[16]  Eitan Altman,et al.  Evolutionary Games in Wireless Networks , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Ekram Hossain,et al.  Distributed Resource Allocation for Relay-Aided Device-to-Device Communication Under Channel Uncertainties: A Stable Matching Approach , 2015, IEEE Transactions on Communications.

[18]  B. Jones BOUNDED RATIONALITY , 1999 .

[19]  Xu Chen,et al.  Exploiting Social Ties for Cooperative D2D Communications: A Mobile Social Networking Case , 2015, IEEE/ACM Transactions on Networking.

[20]  Chunxiao Jiang,et al.  Resource Allocation for Cognitive Small Cell Networks: A Cooperative Bargaining Game Theoretic Approach , 2015, IEEE Transactions on Wireless Communications.

[21]  Ronald Y. Chang,et al.  Joint Mode Selection and Interference Management in Device-to-Device Communications Underlaid MIMO Cellular Networks , 2017, IEEE Transactions on Wireless Communications.

[22]  H. Vincent Poor,et al.  Contract-Based Interference Coordination in Heterogeneous Cloud Radio Access Networks , 2015, IEEE Journal on Selected Areas in Communications.

[23]  Chih-Yu Wang,et al.  Resource allocation in D2D communication - A game theoretic approach , 2014, 2014 IEEE International Conference on Communications Workshops (ICC).

[24]  Liqun Fu,et al.  Energy Efficient D2D Communications in Dynamic TDD Systems , 2017, IEEE Trans. Commun..

[25]  Yoshikazu Miyanaga,et al.  Dynamic Buffer Status-Based Control for LTE-A Network With Underlay D2D Communication , 2016, IEEE Transactions on Communications.

[26]  Yoshikazu Miyanaga,et al.  QoS-Oriented Mode, Spectrum, and Power Allocation for D2D Communication Underlaying LTE-A Network , 2016, IEEE Transactions on Vehicular Technology.

[27]  Setareh Maghsudi,et al.  Channel Selection for Network-Assisted D2D Communication via No-Regret Bandit Learning With Calibrated Forecasting , 2014, IEEE Transactions on Wireless Communications.

[28]  Zhu Han,et al.  Coalitional Games for Resource Allocation in the Device-to-Device Uplink Underlaying Cellular Networks , 2014, IEEE Transactions on Wireless Communications.

[29]  Walid Saad,et al.  Cooperative Cellular Wireless Networks: Coalitional games for cooperative cellular wireless networks , 2011 .

[30]  Zhu Han,et al.  A Bayesian Overlapping Coalition Formation Game for Device-to-Device Spectrum Sharing in Cellular Networks , 2015, IEEE Transactions on Wireless Communications.

[31]  Jinsong Wu,et al.  Energy-Efficient Resource Allocation for Device-to-Device Communications Overlaying LTE Networks , 2015, 2015 IEEE 82nd Vehicular Technology Conference (VTC2015-Fall).