Repeated resource sharing among selfish players with imperfect binary feedback

We develop a novel design framework for resource sharing among self-interested players, who adjust their resource usage levels to compete for a common resource. We model the interaction among the players as a repeated resource sharing game with imperfect monitoring, which captures four unique features of the considered interaction. First, the players inflict negative externality to each other due to the interference/congestion among them. Second, the players interact with each other repeatedly because of their long-term coexistence in the system. Third, since the players are decentralized, they are selfish and aim to maximize their own long-term payoffs from utilizing the resource rather than obeying any prescribed sharing rule. Finally, the players are informed of the interference/congestion level through a binary feedback signal, which is quantized from imperfect observation about the interference/congestion level. We first characterize the set of Pareto optimal operating points that can be achieved by deviation-proof resource sharing policies, which are policies that the selfish players find it in their self-interests to comply with. Next, for any given operating point in this set, we show how to construct a deviation-proof policy to achieve it. The constructed deviation-proof policy is amenable to distributed implementation, and allows players to use the resource in an alternating fashion. In the presence of strong negative externality, our policy outperforms existing resource sharing policies that dictate constant resource usage levels by the players. Moreover, our policy can achieve Pareto optimality even when the players have imperfect binary feedback, as opposed to existing solutions based on repeated game models, which require a large amount of feedback. The proposed design framework applies to many resource sharing systems, such as power control, medium access control (MAC), and flow control.

[1]  John N. Tsitsiklis,et al.  Efficiency loss in a network resource allocation game: the case of elastic supply , 2004, IEEE Transactions on Automatic Control.

[2]  Yi Gai,et al.  A packet dropping-based incentive mechanism for M/M/1 queues with selfish users , 2011, 2011 Proceedings IEEE INFOCOM.

[3]  Cem U. Saraydar,et al.  Efficient power control via pricing in wireless data networks , 2002, IEEE Trans. Commun..

[4]  Tamer Basar,et al.  Optimal Nonlinear Pricing for a Monopolistic Network Service Provider with Complete and Incomplete Information , 2007, IEEE Journal on Selected Areas in Communications.

[5]  Christos Douligeris,et al.  Convergence of synchronous and asynchronous greedy algorithms in a multiclass telecommunications environment , 1992, IEEE Trans. Commun..

[6]  Qing Zhao,et al.  Distributed Learning in Multi-Armed Bandit With Multiple Players , 2009, IEEE Transactions on Signal Processing.

[7]  Liesbet Van der Perre,et al.  A Distributed Multichannel MAC Protocol for Multihop Cognitive Radio Networks , 2010, IEEE Transactions on Vehicular Technology.

[8]  Mihaela van der Schaar,et al.  The Theory of Intervention Games for Resource Sharing in Wireless Communications , 2011, IEEE Journal on Selected Areas in Communications.

[9]  G. Mailath,et al.  Repeated Games and Reputations: Long-Run Relationships , 2006 .

[10]  Mihaela van der Schaar,et al.  Intervention in Power Control Games With Selfish Users , 2011, IEEE Journal of Selected Topics in Signal Processing.

[11]  Bhaskar Krishnamachari,et al.  Dynamic Multichannel Access With Imperfect Channel State Detection , 2010, IEEE Transactions on Signal Processing.

[12]  Christos Douligeris,et al.  A game theoretic perspective to flow control in telecommunication networks , 1992 .

[13]  E. Stacchetti,et al.  Towards a Theory of Discounted Repeated Games with Imperfect Monitoring , 1990 .

[14]  Maria-Gabriella Di Benedetto,et al.  A Survey on MAC Strategies for Cognitive Radio Networks , 2012, IEEE Communications Surveys & Tutorials.

[15]  C. Cordeiro,et al.  C-MAC: A Cognitive MAC Protocol for Multi-Channel Wireless Networks , 2007, 2007 2nd IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks.

[16]  Abhay Parekh,et al.  Spectrum sharing for unlicensed bands , 2005, IEEE Journal on Selected Areas in Communications.

[17]  Qing Zhao,et al.  Cooperative Game in Dynamic Spectrum Access with Unknown Model and Imperfect Sensing , 2012, IEEE Transactions on Wireless Communications.

[18]  Demosthenis Teneketzis,et al.  A game-theoretic approach to decentralized optimal power allocation for cellular networks , 2008, Telecommun. Syst..

[19]  E. Larsson,et al.  Game theory and the flat-fading gaussian interference channel , 2009, IEEE Signal Processing Magazine.

[20]  Mihaela van der Schaar,et al.  Stackelberg Contention Games in Multiuser Networks , 2008, EURASIP J. Adv. Signal Process..

[21]  Samson Lasaulce,et al.  A Repeated Game Formulation of Energy-Efficient Decentralized Power Control , 2010, IEEE Transactions on Wireless Communications.

[22]  Slawomir Stanczak,et al.  On the Convexity of Feasible QoS Regions , 2007, IEEE Transactions on Information Theory.

[23]  Mihaela van der Schaar,et al.  Designing Incentive Schemes Based on Intervention: The Case of Imperfect Monitoring , 2010, GAMENETS.

[24]  K. Bharath-Kumar,et al.  A new approach to performance-oriented flow control , 1981, IEEE Trans. Commun..

[25]  D. Fudenberg,et al.  Digitized by the Internet Archive in 2011 with Funding from Working Paper Department of Economics the Folk Theorem with Imperfect Public Information , 2022 .

[26]  Lei Yang,et al.  Pricing-based spectrum access control in cognitive radio networks with random access , 2011, 2011 Proceedings IEEE INFOCOM.

[27]  Cristina Comaniciu,et al.  Cooperation and Fairness for Slotted Aloha , 2007, Wirel. Pers. Commun..

[28]  Eitan Altman,et al.  A survey on networking games in telecommunications , 2006, Comput. Oper. Res..

[29]  Stephen B. Wicker,et al.  Game theory and the design of self-configuring, adaptive wireless networks , 2001, IEEE Commun. Mag..

[30]  Eitan Altman,et al.  CDMA Uplink Power Control as a Noncooperative Game , 2002, Wirel. Networks.

[31]  Mihaela van der Schaar,et al.  Dynamic Spectrum Sharing Among Repeatedly Interacting Selfish Users With Imperfect Monitoring , 2012, IEEE Journal on Selected Areas in Communications.

[32]  Mihaela van der Schaar,et al.  Transmitting Important Bits and Sailing High Radio Waves: A Decentralized Cross-Layer Approach to Cooperative Video Transmission , 2011, IEEE Journal on Selected Areas in Communications.

[33]  R. Srikant,et al.  Revenue-maximizing pricing and capacity expansion in a many-users regime , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[34]  K. J. Ray Liu,et al.  Repeated open spectrum sharing game with cheat-proof strategies , 2009, IEEE Transactions on Wireless Communications.

[35]  Qing Zhao,et al.  Decentralized dynamic spectrum access for cognitive radios: cooperative design of a non-cooperative game , 2009, IEEE Transactions on Communications.

[36]  Mihaela van der Schaar,et al.  Repeated Games with Intervention: Theory and Applications in Communications , 2011, IEEE Transactions on Communications.

[37]  Mihaela van der Schaar,et al.  A systematic framework for dynamically optimizing multi-user wireless video transmission , 2009, IEEE Journal on Selected Areas in Communications.

[38]  Michael L. Honig,et al.  Auction-Based Spectrum Sharing , 2006, Mob. Networks Appl..

[39]  Demosthenis Teneketzis,et al.  An Externalities-Based Decentralized Optimal Power Allocation Algorithm for Wireless Networks , 2009, IEEE/ACM Transactions on Networking.

[40]  Michael L. Honig,et al.  Distributed interference compensation for wireless networks , 2006, IEEE Journal on Selected Areas in Communications.

[41]  Mihaela van der Schaar,et al.  Linearly Coupled Communication Games , 2009, IEEE Transactions on Communications.