Approximation algorithms for wireless opportunistic spectrum scheduling in cognitive radio networks

Given a set of communication links in cognitive radio networks, assume that the underlying channel state information along each link is unknown; however, we can estimate it by exploiting the feedbacks and evolutions of channel states. Assume time is divided into time-slots. Under the protocol interference model, the opportunistic spectrum scheduling problem aims to select interference-free links to transmit at each time-slot to maximize the average throughput over the long time horizon. Existing works on the opportunistic spectrum scheduling problem cannot satisfyingly address the wireless interference constraints. We apply the framework of restless multi-armed bandit and develop approximation algorithms for the problem with stochastic identical links and nonidentical links respectively. Based on the updated estimations of channel states, the proposed algorithms keep refining future link scheduling decisions. We also obtain approximation bounds of these two proposed algorithms.

[1]  P. Whittle Restless bandits: activity allocation in a changing world , 1988, Journal of Applied Probability.

[2]  J. Bather,et al.  Multi‐Armed Bandit Allocation Indices , 1990 .

[3]  Dimitris Bertsimas,et al.  Restless Bandits, Linear Programming Relaxations, and a Primal-Dual Index Heuristic , 2000, Oper. Res..

[4]  Kevin D. Glazebrook,et al.  Multi-Armed Bandit Allocation Indices: Gittins/Multi-Armed Bandit Allocation Indices , 2011 .

[5]  XiaoHua Xu,et al.  Weighted Restless Bandit and Its Applications , 2015, 2015 IEEE 35th International Conference on Distributed Computing Systems.

[6]  Christian M. Ernst,et al.  Multi-armed Bandit Allocation Indices , 1989 .

[7]  Atilla Eryilmaz,et al.  Exploiting Channel Memory for Joint Estimation and Scheduling in Downlink Networks—a Whittle’s Indexability Analysis , 2010, IEEE Transactions on Information Theory.

[8]  H. Vincent Poor,et al.  Spectrum Exploration and Exploitation for Cognitive Radio: Recent Advances , 2015, IEEE Signal Processing Magazine.

[9]  Qing Zhao,et al.  Indexability of Restless Bandit Problems and Optimality of Whittle Index for Dynamic Multichannel Access , 2008, IEEE Transactions on Information Theory.

[10]  Mingyan Liu,et al.  Optimality of Myopic Sensing in Multi-Channel Opportunistic Access , 2008, 2008 IEEE International Conference on Communications.

[11]  E. Gilbert Capacity of a burst-noise channel , 1960 .

[12]  Peng Shi,et al.  Approximation algorithms for restless bandit problems , 2007, JACM.

[13]  Michael J. Neely,et al.  Network utility maximization over partially observable Markovian channels , 2013, Perform. Evaluation.

[14]  José Niño Mora Restless Bandits, Partial Conservation Laws and Indexability , 2000 .

[15]  Panganamala Ramana Kumar,et al.  RHEINISCH-WESTFÄLISCHE TECHNISCHE HOCHSCHULE AACHEN , 2001 .

[16]  Qi Cheng,et al.  Derandomization of Sparse Cyclotomic Integer Zero Testing , 2007, 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07).

[17]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[18]  Eytan Modiano,et al.  Scheduling in networks with time-varying channels and reconfiguration delay , 2012, 2012 Proceedings IEEE INFOCOM.

[19]  Sudipto Guha,et al.  Approximation Algorithms for Partial-Information Based Stochastic Control with Markovian Rewards , 2007, 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07).

[20]  José Niño-Mora,et al.  Dynamic priority allocation via restless bandit marginal productivity indices , 2007, 2304.06115.

[21]  Atilla Eryilmaz,et al.  Low-Complexity Optimal Scheduling over Time-Correlated Fading Channels with ARQ Feedback , 2012, IEEE Transactions on Mobile Computing.

[22]  Mingyan Liu,et al.  Multi-channel opportunistic access: A case of restless bandits with multiple plays , 2009, 2009 47th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[23]  Michael J. Neely,et al.  Network utility maximization over partially observable Markovian channels , 2010, 2011 International Symposium of Modeling and Optimization of Mobile, Ad Hoc, and Wireless Networks.

[24]  Ananthram Swami,et al.  Decentralized cognitive MAC for opportunistic spectrum access in ad hoc networks: A POMDP framework , 2007, IEEE Journal on Selected Areas in Communications.