Optimal Policy of Cross-Layer Design for Channel Access and Transmission Rate Adaptation in Cognitive Radio Networks

In this paper, we investigate the cross-layer design of joint channel access and transmission rate adaptation in CR networks with multiple channels for both centralized and decentralized cases. Our target is to maximize the throughput of CR network under transmission power constraint by taking spectrum sensing errors into account. In centralized case, this problem is formulated as a special constrained Markov decision process (CMDP), which can be solved by standard linear programming (LP) method. As the complexity of finding the optimal policy by LP increases exponentially with the size of action space and state space, we further apply action set reduction and state aggregation to reduce the complexity without loss of optimality. Meanwhile, for the convenience of implementation, we also consider the pure policy design and analyze the corresponding characteristics. In decentralized case, where only local information is available and there is no coordination among the CR users, we prove the existence of the constrained Nash equilibrium and obtain the optimal decentralized policy. Finally, in the case that the traffic load parameters of the licensed users are unknown for the CR users, we propose two methods to estimate the parameters for two different cases. Numerical results validate the theoretic analysis.

[1]  Rachid El Azouzi,et al.  Constrained Stochastic Games in Wireless Networks , 2007, IEEE GLOBECOM 2007 - IEEE Global Telecommunications Conference.

[2]  R. Barlow,et al.  Reliability Analysis of a One-Unit System , 1961 .

[3]  Vijay K. Bhargava,et al.  Optimal and suboptimal packet scheduling over correlated time varying flat fading channels , 2006, IEEE Transactions on Wireless Communications.

[4]  I.D. O'Donnell,et al.  Spectrum sharing radios , 2006, IEEE Circuits and Systems Magazine.

[5]  J. Goodman Note on Existence and Uniqueness of Equilibrium Points for Concave N-Person Games , 1965 .

[6]  Hong Shen Wang,et al.  Finite-state Markov channel-a useful model for radio communication channels , 1995 .

[7]  Hua Liu,et al.  Cooperation and Learning in Multiuser Opportunistic Spectrum Access , 2008, ICC Workshops - 2008 IEEE International Conference on Communications Workshops.

[8]  Vijay K. Bhargava,et al.  Delay limited optimal and suboptimal power and bit loading algorithms for OFDM systems over correlated fading channels , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[9]  P. Mandl,et al.  Estimation and control in Markov chains , 1974, Advances in Applied Probability.

[10]  Brian M. Sadler,et al.  A Survey of Dynamic Spectrum Access , 2007, IEEE Signal Processing Magazine.

[11]  Yiyang Pei,et al.  Sensing-Throughput Tradeoff in Cognitive Radio Networks: How Frequently Should Spectrum Sensing be Carried Out? , 2007, 2007 IEEE 18th International Symposium on Personal, Indoor and Mobile Radio Communications.

[12]  Eitan Altman,et al.  Discrete Power Control: Cooperative and Non-Cooperative Optimization , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[13]  Kang G. Shin,et al.  Efficient Discovery of Spectrum Opportunities with MAC-Layer Sensing in Cognitive Radio Networks , 2008, IEEE Transactions on Mobile Computing.

[14]  Simon Haykin,et al.  Cognitive radio: brain-empowered wireless communications , 2005, IEEE Journal on Selected Areas in Communications.

[15]  Patrick Mitran,et al.  Limits on communications in a cognitive radio channel , 2006, IEEE Communications Magazine.

[16]  Ananthram Swami,et al.  Distributed Spectrum Sensing and Access in Cognitive Radio Networks With Energy Constraint , 2009, IEEE Transactions on Signal Processing.

[17]  Ananthram Swami,et al.  Decentralized cognitive MAC for opportunistic spectrum access in ad hoc networks: A POMDP framework , 2007, IEEE Journal on Selected Areas in Communications.

[18]  L. Baxter AVAILABILITY MEASURES FOR A TWO-STATE SYSTEM , 1981 .

[19]  Hua Liu,et al.  Randomized Strategies for Multi-User Multi-Channel Opportunity Sensing , 2007 .

[20]  Andrea J. Goldsmith,et al.  Degrees of freedom in adaptive modulation: a unified view , 2001, IEEE Trans. Commun..

[21]  Ian F. Akyildiz,et al.  NeXt generation/dynamic spectrum access/cognitive radio wireless networks: A survey , 2006, Comput. Networks.

[22]  Joseph Mitola,et al.  Cognitive radio: making software radios more personal , 1999, IEEE Wirel. Commun..

[23]  Yonghong Zeng,et al.  Sensing-Throughput Tradeoff for Cognitive Radio Networks , 2008, IEEE Trans. Wirel. Commun..

[24]  Wei Liu,et al.  Randomized Multi-User Strategy for Spectrum Sharing in Opportunistic Spectrum Access Network , 2008, ICC Workshops - 2008 IEEE International Conference on Communications Workshops.

[25]  E. Altman Constrained Markov Decision Processes , 1999 .

[26]  Qing Zhao,et al.  Distributed Sensing and Access in Cognitive Radio Networks , 2008, 2008 IEEE 10th International Symposium on Spread Spectrum Techniques and Applications.

[27]  Ananthram Swami,et al.  Joint Design and Separation Principle for Opportunistic Spectrum Access in the Presence of Sensing Errors , 2007, IEEE Transactions on Information Theory.

[28]  Amir Ghasemi,et al.  Optimization of Spectrum Sensing for Opportunistic Spectrum Access in Cognitive Radio Networks , 2007, 2007 4th IEEE Consumer Communications and Networking Conference.