Channel Access Optimization with Adaptive Congestion Pricing for Cognitive Vehicular Networks: An Evolutionary Game Approach

Cognitive radio-enabled vehicular nodes as unlicensed users can competitively and opportunistically access the radio spectrum provided by a licensed provider and simultaneously use a dedicated channel for vehicular communications. In such cognitive vehicular networks, channel access optimization plays a key role in making the most of the spectrum resources. In this paper, we present the competition among self-interest-driven vehicular nodes as an evolutionary game and study fundamental properties of the Nash equilibrium and the evolutionary stability. To deal with the inefficiency of the Nash equilibrium, we design a delayed pricing mechanism and propose a discretized replicator dynamics with this pricing mechanism. The strategy adaptation and the channel pricing can be performed in an asynchronous manner, such that vehicular users can obtain the knowledge of the channel prices prior to actually making access decisions. We prove that the Nash equilibrium of the proposed evolutionary dynamics is evolutionary stable and coincides with the social optimum. Besides, performance comparison is also carried out in different environments to demonstrate the effectiveness and advantages of our method over the distributed multi-agent reinforcement learning scheme in current literature in terms of the system convergence, stability and adaptability.

[1]  Hai Yang,et al.  Principle of marginal-cost pricing : How does it work in a general road network ? , 1998 .

[2]  Dusit Niyato,et al.  Pricing, Spectrum Sharing, and Service Selection in Two-Tier Small Cell Networks: A Hierarchical Dynamic Game Approach , 2014, IEEE Transactions on Mobile Computing.

[3]  Dusit Niyato,et al.  Spectrum trading in cognitive radio networks: A market-equilibrium-based approach , 2008, IEEE Wirel. Commun..

[4]  Jianhong Zhou,et al.  Smart Multi-RAT Access Based on Multiagent Reinforcement Learning , 2018, IEEE Transactions on Vehicular Technology.

[5]  P. Dubey Nash equilibria of market games: Finiteness and inefficiency☆ , 1980 .

[6]  Dusit Niyato,et al.  A Noncooperative Game-Theoretic Framework for Radio Resource Management in 4G Heterogeneous Wireless Access Networks , 2008, IEEE Transactions on Mobile Computing.

[7]  A. C. Pigou Economics of welfare , 1920 .

[8]  Qing Zhao,et al.  Decentralized dynamic spectrum access for cognitive radios: cooperative design of a non-cooperative game , 2009, IEEE Transactions on Communications.

[9]  Ian F. Akyildiz,et al.  NeXt generation/dynamic spectrum access/cognitive radio wireless networks: A survey , 2006, Comput. Networks.

[10]  R. Rosenthal A class of games possessing pure-strategy Nash equilibria , 1973 .

[11]  Alagan Anpalagan,et al.  Opportunistic Spectrum Access in Cognitive Radio Networks: Global Optimization Using Local Interaction Games , 2012, IEEE Journal of Selected Topics in Signal Processing.

[12]  Alagan Anpalagan,et al.  Opportunistic Spectrum Access in Unknown Dynamic Environment: A Game-Theoretic Stochastic Learning Solution , 2012, IEEE Transactions on Wireless Communications.

[13]  Ekram Hossain,et al.  Dynamic Spectrum Access and Management in Cognitive Radio Networks , 2009 .

[14]  V. Borkar Stochastic Approximation: A Dynamical Systems Viewpoint , 2008 .

[15]  M. Nowak,et al.  Evolutionary game theory , 1995, Current Biology.

[16]  Yu-Dong Yao,et al.  Cooperative Spectrum Sensing With Random Access Reporting Channels in Cognitive Radio Networks , 2017, IEEE Transactions on Vehicular Technology.

[17]  Jörgen W. Weibull,et al.  Evolutionary Game Theory , 1996 .

[18]  Dusit Niyato,et al.  Competitive spectrum sharing in cognitive radio networks: a dynamic game approach , 2008, IEEE Transactions on Wireless Communications.

[19]  Xuemin Shen,et al.  Integrity-oriented content transmission in highway vehicular ad hoc networks , 2013, 2013 Proceedings IEEE INFOCOM.

[20]  Joseph Mitola,et al.  Cognitive radio: making software radios more personal , 1999, IEEE Wirel. Commun..

[21]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[22]  Xu Chen,et al.  Evolutionarily Stable Spectrum Access , 2012, IEEE Transactions on Mobile Computing.

[23]  Dusit Niyato,et al.  Market-Equilibrium, Competitive, and Cooperative Pricing for Spectrum Sharing in Cognitive Radio Networks: Analysis and Comparison , 2008, IEEE Transactions on Wireless Communications.

[24]  Vincent W. S. Wong,et al.  An Overlapping Coalitional Game for Cooperative Spectrum Sensing and Access in Cognitive Radio Networks , 2016, IEEE Transactions on Vehicular Technology.

[25]  John B. Kenney,et al.  Dedicated Short-Range Communications (DSRC) Standards in the United States , 2011, Proceedings of the IEEE.

[26]  J. Hofbauer,et al.  Evolutionary game dynamics , 2011 .

[27]  Yide Wang,et al.  Distributed Interference-Aware Cooperative MAC Based on Stackelberg Pricing Game , 2015, IEEE Transactions on Vehicular Technology.

[28]  小泉 信三 社会政策の原理 : Pigou, The economics of welfareを読む , 1923 .

[29]  Pradeep Dubey,et al.  Inefficiency of Nash Equilibria , 1986, Math. Oper. Res..

[30]  Hamid Aghvami,et al.  Cognitive Radio game for secondary spectrum access problem , 2009, IEEE Transactions on Wireless Communications.

[31]  Mehul Motani,et al.  Price-Based Resource Allocation for Spectrum-Sharing Femtocell Networks: A Stackelberg Game Approach , 2012, IEEE Journal on Selected Areas in Communications.

[32]  Zhu Han,et al.  Dynamics of Multiple-Seller and Multiple-Buyer Spectrum Trading in Cognitive Radio Networks: A Game-Theoretic Modeling Approach , 2009, IEEE Transactions on Mobile Computing.

[33]  Dusit Niyato,et al.  Dynamics of Network Selection in Heterogeneous Wireless Networks: An Evolutionary Game Approach , 2009, IEEE Transactions on Vehicular Technology.

[34]  Bin Fu,et al.  Utility-Maximized Two-Level Game-Theoretic Approach for Bandwidth Allocation in Heterogeneous Radio Access Networks , 2017, IEEE Transactions on Vehicular Technology.

[35]  Dusit Niyato,et al.  Optimal Channel Access Management with QoS Support for Cognitive Vehicular Networks , 2011, IEEE Transactions on Mobile Computing.

[36]  M.M. Buddhikot,et al.  Understanding Dynamic Spectrum Access: Models,Taxonomy and Challenges , 2007, 2007 2nd IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks.

[37]  Dusit Niyato,et al.  Competitive Pricing for Spectrum Sharing in Cognitive Radio Networks: Dynamic Game, Inefficiency of Nash Equilibrium, and Collusion , 2008, IEEE Journal on Selected Areas in Communications.

[38]  Husheng Li Multiagent Q-Learning for Aloha-Like Spectrum Access in Cognitive Radio Systems , 2010, EURASIP J. Wirel. Commun. Netw..

[39]  K. R. Chowdhury,et al.  Smart Radios for Smart Vehicles: Cognitive Vehicular Networks , 2012, IEEE Vehicular Technology Magazine.

[40]  Georgios B. Giannakis,et al.  Cross-Layer combining of adaptive Modulation and coding with truncated ARQ over wireless links , 2004, IEEE Transactions on Wireless Communications.

[41]  Bhaskar Krishnamachari,et al.  Deep Reinforcement Learning for Dynamic Multichannel Access in Wireless Networks , 2018, IEEE Transactions on Cognitive Communications and Networking.

[42]  Victor C. M. Leung,et al.  Connectivity Analysis for Cooperative Vehicular Ad Hoc Networks Under Nakagami Fading Channel , 2014, IEEE Communications Letters.