Novel QoS-Aware Proactive Spectrum Access Techniques for Cognitive Radio Using Machine Learning

Traditional cognitive radio (CR) spectrum access techniques have been primitive and inefficient due to being blind to the occupancy conditions of the spectrum bands to be sensed. In addition, current spectrum access techniques are also unable to detect network changes or even consider the requirements of unlicensed users, leading to a poorer quality of service (QoS) and excessive latency. As user-specific approaches will play a key role in future wireless communication networks, the conventional CR spectrum access should also be updated in order to be more effective and agile. In this paper, a comprehensive and novel solution is proposed to decrease the sensing latency and to make the CR networks (CRNs) aware of unlicensed user requirements. As such, a proactive process with a novel QoS-based optimization phase is proposed, consisting of two different decision strategies. Initially, future traffic loads of the different radio access technologies (RATs), occupying different bands of the spectrum, are predicted using the artificial neural networks (ANNs). Based on these predictions, two strategies are proposed. In the first one, which solely focuses on latency, a virtual wideband (WB) sensing approach is developed, where predicted relative traffic loads in WB are exploited to enable narrowband (NB) sensing. The second one, based on $Q$ -learning, focuses not only on minimizing the sensing latency but also on satisfying other user requirements. The results reveal that the first strategy manages to significantly reduce the sensing latency of the random selection process by 59.6%, while the $Q$ -learning assisted second strategy enhanced the full-satisfaction by up to 95.7%.

[1]  Mohsen Hejazi,et al.  Cyclostationarity-Based Multi-Antenna Cooperative Spectrum Sensing in Cognitive Radio Networks Over Correlated Fading Channels , 2018, Electrical Engineering (ICEE), Iranian Conference on.

[2]  Katsiaryna Mirylenka,et al.  Characterizing Home Device Usage From Wireless Traffic Time Series , 2016, EDBT.

[3]  Ashraf Eltholth,et al.  Forward Backward autoregressive spectrum prediction scheme in Cognitive Radio Systems , 2015, 2015 9th International Conference on Signal Processing and Communication Systems (ICSPCS).

[4]  Martin T. Hagan,et al.  Gauss-Newton approximation to Bayesian learning , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[5]  David J. Ketchen,et al.  THE APPLICATION OF CLUSTER ANALYSIS IN STRATEGIC MANAGEMENT RESEARCH: AN ANALYSIS AND CRITIQUE , 1996 .

[6]  Jian Yang,et al.  Enhanced Throughput of Cognitive Radio Networks by Imperfect Spectrum Prediction , 2015, IEEE Communications Letters.

[7]  Metin Öztürk,et al.  Introducing a Novel Minimum Accuracy Concept for Predictive Mobility Management Schemes , 2018, 2018 IEEE International Conference on Communications Workshops (ICC Workshops).

[8]  Jun Wang,et al.  Cooperative Spectrum Sensing in Heterogeneous Cognitive Radio Networks Based on Normalized Energy Detection , 2016, IEEE Transactions on Vehicular Technology.

[9]  Tao Luo,et al.  Autoregressive Spectrum Hole Prediction Model for Cognitive Radio Systems , 2008, ICC Workshops - 2008 IEEE International Conference on Communications Workshops.

[10]  Ren Ping Liu,et al.  ResInNet: A Novel Deep Neural Network With Feature Reuse for Internet of Things , 2019, IEEE Internet of Things Journal.

[11]  Geoffrey Ye Li,et al.  Cognitive radio networking and communications: an overview , 2011, IEEE Transactions on Vehicular Technology.

[12]  Joseph Mitola,et al.  Cognitive radio: making software radios more personal , 1999, IEEE Wirel. Commun..

[13]  Zhen Hu,et al.  Channel state prediction in cognitive radio, Part II: Single-user prediction , 2011, 2011 Proceedings of IEEE Southeastcon.

[14]  Ying-Chang Liang,et al.  Sparsity Independent Sub-Nyquist Rate Wideband Spectrum Sensing on Real-Time TV White Space , 2017, IEEE Transactions on Vehicular Technology.

[15]  Sang-Won Kim,et al.  HMM Based Channel Status Predictor for Cognitive Radio , 2007, 2007 Asia-Pacific Microwave Conference.

[16]  Wei Cheng,et al.  Spectrum prediction in cognitive radio networks , 2013, IEEE Wireless Communications.

[17]  Dusit Niyato,et al.  A Neural Network Based Spectrum Prediction Scheme for Cognitive Radio , 2010, 2010 IEEE International Conference on Communications.

[18]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[19]  Robin J. Evans,et al.  Cooperative Soft Fusion for HMM-Based Spectrum Occupancy Prediction , 2018, IEEE Communications Letters.

[20]  Hüseyin Arslan,et al.  A survey of spectrum sensing algorithms for cognitive radio applications , 2009, IEEE Communications Surveys & Tutorials.

[21]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[22]  Ian F. Akyildiz,et al.  A survey on spectrum management in cognitive radio networks , 2008, IEEE Communications Magazine.

[23]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[24]  Alexander M. Wyglinski,et al.  A Spectrum Surveying Framework for Dynamic Spectrum Access Networks , 2009, IEEE Transactions on Vehicular Technology.

[25]  Gottapu Sasibhushana Rao,et al.  Spectrum Sensing for Fading Wireless Channel Using Matched Filter , 2017, SocProS.

[26]  Anil K. Jain Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[27]  AKHIL GUPTA,et al.  A Survey of 5G Network: Architecture and Emerging Technologies , 2015, IEEE Access.

[28]  Yanxiao Zhao,et al.  Prediction-Based Spectrum Management in Cognitive Radio Networks , 2018, IEEE Systems Journal.

[29]  Sweta Jain,et al.  Spectrum Prediction Using Time Delay Neural Network in Cognitive Radio Network , 2018, Smart Innovations in Communication and Computational Sciences.

[30]  Heaton T. Jeff,et al.  Introduction to Neural Networks with Java , 2005 .

[31]  Samuel J. Gershman,et al.  Predictive representations can link model-based reinforcement learning to model-free mechanisms , 2017 .

[32]  Hui Xiong,et al.  K-means clustering versus validation measures: a data distribution perspective , 2006, KDD '06.

[33]  Jian Yang,et al.  Genetic algorithm optimized training for neural network spectrum prediction , 2016, 2016 2nd IEEE International Conference on Computer and Communications (ICCC).

[34]  Cheng-Xiang Wang,et al.  Wideband spectrum sensing for cognitive radio networks: a survey , 2013, IEEE Wireless Communications.

[35]  Wenbo Wang,et al.  Prediction-Based Spectrum Access Optimization in Cognitive Radio Networks , 2018, 2018 IEEE 29th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC).