Opportunistic Access to Spectrum Holes Between Packet Bursts: A Learning-Based Approach

We present a cognitive radio (CR) mechanism for opportunistic access to the frequency bands licensed to a data-centric primary user (PU) network. Secondary users (SUs) aim to exploit the short-lived spectrum holes (or opportunities) created between packet bursts in the PU network. The PU traffic pattern changes over both time and frequency according to upper layer events in the PU network, and fast variation in PU activity may cause high sensing error probability and low spectrum utilization in dynamic spectrum access. The proposed mechanism learns a PU traffic pattern in real-time and uses the acquired information to access the frequency channel in an efficient way while limiting the probability of collision with the PUs below a target limit. To design the channel learning algorithm, we model the CR system as a hidden Markov model (HMM) and present a gradient method to find the underlying PU traffic pattern. We also analyze the identifiability of the proposed HMM to provide a condition for the convergence of the proposed learning algorithm. Simulation results show that the proposed algorithm greatly outperforms the traditional listen-before-talk algorithm which does not possess any learning functionality.

[1]  T. Rydén.  On recursive estimation for hidden Markov models , 1997 .

[2]  Michael J. Neely,et al.  Opportunistic Scheduling with Reliability Guarantees in Cognitive Radio Networks , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[3]  Shun-ichi Amari,et al.  Identifiability of hidden Markov information sources and their minimum degrees of freedom , 1992, IEEE Trans. Inf. Theory.

[4]  Brian M. Sadler,et al.  Opportunistic Spectrum Access via Periodic Channel Sensing , 2008, IEEE Transactions on Signal Processing.

[5]  Brian M. Sadler,et al.  Cognitive Medium Access: Constraining Interference Based on Experimental Models , 2008, IEEE Journal on Selected Areas in Communications.

[6]  Brian M. Sadler,et al.  COGNITIVE RADIOS FOR DYNAMIC SPECTRUM ACCESS - Dynamic Spectrum Access in the Time Domain: Modeling and Exploiting White Space , 2007, IEEE Communications Magazine.

[7]  Lang Tong,et al.  A Measurement-Based Model for Dynamic Spectrum Access in WLAN Channels , 2006, MILCOM 2006 - 2006 IEEE Military Communications conference.

[8]  L. Baum,et al.  Statistical Inference for Probabilistic Functions of Finite State Markov Chains , 1966 .

[9]  Adam Wolisz,et al.  Primary user behavior in cellular networks and implications for dynamic spectrum access , 2009, IEEE Communications Magazine.

[10]  H. Vincent Poor,et al.  Optimal selection of channel sensing order in cognitive radio , 2009, IEEE Transactions on Wireless Communications.

[11]  T. Clancy,et al.  Predictive Dynamic Spectrum Access , 2006 .

[12]  George E. Monahan,et al.  A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 2007 .

[13]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[14]  W. Lovejoy.  A survey of algorithmic methods for partially observed Markov decision processes , 1991 .

[15]  H. Urkowitz.  Energy detection of unknown deterministic signals , 1967 .

[16]  Xuemin Shen,et al.  HC-MAC: A Hardware-Constrained Cognitive MAC for Efficient Spectrum Management , 2008, IEEE Journal on Selected Areas in Communications.

[17]  Kae Won Choi.  Adaptive Sensing Technique to Maximize Spectrum Utilization in Cognitive Radio , 2010, IEEE Transactions on Vehicular Technology.

[18]  Ananthram Swami,et al.  Decentralized cognitive MAC for opportunistic spectrum access in ad hoc networks: A POMDP framework , 2007, IEEE Journal on Selected Areas in Communications.

[19]  I-Jeng Wang,et al.  Characterization of Spectrum Activities in the U.S. Public Safety Band for Opportunistic Spectrum Access , 2007, 2007 2nd IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks.

[20]  Zhi Ding,et al.  Optimal Transmission Strategies for Dynamic Spectrum Access in Cognitive Radio Networks , 2009, IEEE Transactions on Mobile Computing.

[21]  Hang Su,et al.  Cross-Layer Based Opportunistic MAC Protocols for QoS Provisionings Over Cognitive Radio Wireless Networks , 2008, IEEE Journal on Selected Areas in Communications.

[22]  Hai Jiang,et al.  Channel Sensing-Order Setting in Cognitive Radio Networks: A Two-User Case , 2009, IEEE Transactions on Vehicular Technology.

[23]  Kang G. Shin,et al.  Efficient Discovery of Spectrum Opportunities with MAC-Layer Sensing in Cognitive Radio Networks , 2008, IEEE Transactions on Mobile Computing.

[24]  H. Vincent Poor,et al.  Cognitive Medium Access: Exploration, Exploitation, and Competition , 2007, IEEE Transactions on Mobile Computing.

[25]  Petri Mähönen,et al.  Lessons learned from an extensive spectrum occupancy measurement campaign and a stochastic duty cycle model , 2009, TRIDENTCOM.

[26]  G. Monahan.  State of the Art—A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 1982 .

[27]  Bhaskar Krishnamachari,et al.  On myopic sensing for multi-channel opportunistic access: structure, optimality, and performance , 2007, IEEE Transactions on Wireless Communications.

[28]  W.H. Tranter,et al.  Dynamic spectrum allocation in cognitive radio using hidden Markov models: Poisson distributed case , 2007, Proceedings 2007 IEEE SoutheastCon.

[29]  Zhi Ding,et al.  Opportunistic spectrum access in cognitive radio networks , 2008, IJCNN.

[30]  Yonghong Zeng,et al.  Sensing-Throughput Tradeoff for Cognitive Radio Networks , 2008, IEEE Trans. Wirel. Commun..

[31]  Neri Merhav,et al.  Hidden Markov processes , 2002, IEEE Trans. Inf. Theory.

[32]  Janne Riihijärvi,et al.  Empirical time and frequency domain models of spectrum use , 2009, Phys. Commun..