Application-value-awareness cross-layer MAC cooperative game for vehicular networks

Abstract In vehicular ad-hoc networks (VANETs), numerous safety related applications have a stringent requirement for the upper latency limit for transmission of messages between vehicles. Thus, it is necessary to design a high-efficiency medium access control (MAC) method that can ensure the allowed upper limit of message delivery delay is satisfied. In this study, we propose the concept of application value (i.e., the value of a conveyed packet), and correlate it with the waiting time of a packet determined by the delay of each concerned message. Subsequently, we design an inter-vehicle cross-layer cooperative game model taking into account the global optimal utility of the participants. Next, we theoretically prove the existence of an equilibrium using a Markov decision process (MDP), and provide a concrete approach to obtain the channel access probability of a node according to the best response method. Finally, we present the results of a partially observable MDP (POMDP) and of the extensive numerical analyses of the performance indicators such as the access delay, throughput, and packet delivery rate (PDR). These are compared with the IEEE 802.11p protocol in saturated and unsaturated states. These comparisons show that the proposed cross-layer MAC cooperative game method guarantees the message transmission delay when the channel is nearly saturated, enabling a successful delivery of the messages within the time limit and providing a strong support to delay-sensitive safety related applications.

[1]  James E. Smith,et al.  Structural Properties of Stochastic Dynamic Programs , 2002, Oper. Res..

[2]  Thierry Ernst,et al.  Performance analysis of secure beaconing messages for GeoNetworking , 2014, Secur. Commun. Networks.

[3]  Peijian Ju,et al.  Repeated Game Analysis for Cooperative MAC With Incentive Design for Wireless Networks , 2016, IEEE Transactions on Vehicular Technology.

[4]  Floriano De Rango,et al.  A Predictive Cross-Layered Interference Management in a Multichannel MAC with Reactive Routing in VANET , 2016, IEEE Transactions on Mobile Computing.

[5]  B. Hajek Optimal control of two interacting service stations , 1982, 1982 21st IEEE Conference on Decision and Control.

[6]  Xin Xu,et al.  Reinforcement learning algorithms with function approximation: Recent advances and applications , 2014, Inf. Sci..

[7]  Bikramjit Banerjee,et al.  Reinforcement Learning of Informed Initial Policies for Decentralized Planning , 2015, TAAS.

[8]  Y. H. Kwon,et al.  Bayesian game-theoretic approach based on 802.11p MAC protocol to alleviate beacon collision under urban VANETs , 2016 .

[9]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[10]  Yide Wang,et al.  Distributed Interference-Aware Cooperative MAC Based on Stackelberg Pricing Game , 2015, IEEE Transactions on Vehicular Technology.

[11]  A. Robert Calderbank,et al.  Reverse-Engineering MAC: A Non-Cooperative Game Model , 2007, IEEE Journal on Selected Areas in Communications.

[12]  Jagruti Sahoo,et al.  Congestion-Controlled-Coordinator-Based MAC for Safety-Critical Message Transmission in VANETs , 2013, IEEE Transactions on Intelligent Transportation Systems.

[13]  Xuemin Shen,et al.  Opportunistic Spectrum Access for CR-VANETs: A Game-Theoretic Approach , 2014, IEEE Transactions on Vehicular Technology.

[14]  Michael P. Wellman,et al.  Computing Best-Response Strategies in Infinite Games of Incomplete Information , 2004, UAI.

[15]  Choong Seon Hong,et al.  An Efficient and Reliable MAC in VANETs , 2014, IEEE Communications Letters.

[16]  Rajarathnam Chandramouli,et al.  Reciprocity, fairness and learning in medium access control games , 2014, Comput. Commun..

[17]  Lijun Chen,et al.  A Game-Theoretic Framework for Medium Access Control , 2008, IEEE Journal on Selected Areas in Communications.

[18]  Weihua Zhuang,et al.  CAH-MAC: Cooperative ADHOC MAC for Vehicular Networks , 2013, IEEE Journal on Selected Areas in Communications.

[19]  Guy Shani,et al.  Noname manuscript No. (will be inserted by the editor) A Survey of Point-Based POMDP Solvers , 2022 .

[20]  Ashutosh Nayyar,et al.  Optimal Control Strategies in Delayed Sharing Information Structures , 2010, IEEE Transactions on Automatic Control.

[21]  Xue Liu,et al.  Performance and Reliability Analysis of IEEE 802.11p Safety Communication in a Highway Environment , 2013, IEEE Transactions on Vehicular Technology.

[22]  Charles L. Isbell,et al.  Markov Games of Incomplete Information for Multi-Agent Reinforcement Learning , 2011, Interactive Decision Theory and Game Theory.

[23]  Achilleas Anastasopoulos,et al.  Stochastic Control of Relay Channels With Cooperative and Strategic Users , 2014, IEEE Transactions on Communications.