Cognitive Radio Algorithms Coexisting in a Network: Performance and Parameter Sensitivity

This paper studies the performance of cognitive radios in a scenario where different pairs of radios adopt different cognition/decision making approaches. We want to assess: 1) if there is a category of cognitive radio algorithms that consistently outperforms the others and 2) how sensitive different algorithms are to suboptimal parameter setting. Our approach is to take a representative set of well-known classes of cognitive radio algorithms, mix and match them throughout thousands of simulations, and determine which seem to perform better. We find that choosing a cognitive radio algorithm means finding a balance between the best-case performance obtained by optimally setting all parameters, and the behavior in uncontrolled, unknown environments, where suboptimal decisions are likely to be made. The approaches we consider, namely reinforcement learning, optimization metaheuristics, multi-armed bandit solutions, and supervised learning, greatly differ in their performance. For example, schemes that are able to achieve a high throughput in our simulation study are more sensitive to suboptimally set parameters.

[1]  Charles W. Bostian,et al.  Artificial Intelligence in Wireless Communications , 2009 .

[2]  Yan Zhang,et al.  Dynamic Spectrum Access in Cognitive Radio Wireless Networks , 2008, 2008 IEEE International Conference on Communications.

[3]  Csaba Szepesvári,et al.  Tuning Bandit Algorithms in Stochastic Environments , 2007, ALT.

[4]  Andrea Giorgetti,et al.  Analysis and performance comparison of different cognitive radio algorithms , 2009, 2009 Second International Workshop on Cognitive Radio and Advanced Spectrum Management.

[5]  D. Hamby A comparison of sensitivity analysis techniques. , 1995, Health physics.

[6]  Nazanin Rahnavard,et al.  A Learning-Based QoE-Driven Spectrum Handoff Scheme for Multimedia Transmissions over Cognitive Radio Networks , 2014, IEEE Journal on Selected Areas in Communications.

[7]  K. J. Ray Liu,et al.  Advances in cognitive radio networks: A survey , 2011, IEEE Journal of Selected Topics in Signal Processing.

[8]  Simon Haykin,et al.  Cognitive radio: brain-empowered wireless communications , 2005, IEEE Journal on Selected Areas in Communications.

[9]  Linda Doyle,et al.  Cyclostationary Signatures in Practical Cognitive Radio Applications , 2008, IEEE Journal on Selected Areas in Communications.

[10]  Nirwan Ansari,et al.  Maximizing Network Capacity of Cognitive Radio Networks by Capacity-Aware Spectrum Allocation , 2015, IEEE Transactions on Wireless Communications.

[11]  Simon Haykin,et al.  Fundamental Issues in Cognitive Radio , 2007 .

[12]  Zhu Han,et al.  Distributive Opportunistic Spectrum Access for Cognitive Radio using Correlated Equilibrium and No-Regret Learning , 2007, 2007 IEEE Wireless Communications and Networking Conference.

[13]  Liljana Gavrilovska,et al.  Learning and Reasoning in Cognitive Radio Networks , 2013, IEEE Communications Surveys & Tutorials.

[14]  Jiaheng Wang,et al.  Robust MIMO Cognitive Radio Via Game Theory , 2011, IEEE Transactions on Signal Processing.

[15]  Fangwen Fu,et al.  Detection of Spectral Resources in Cognitive Radios Using Reinforcement Learning , 2008, 2008 3rd IEEE Symposium on New Frontiers in Dynamic Spectrum Access Networks.

[16]  Maria-Gabriella Di Benedetto,et al.  A Survey on MAC Strategies for Cognitive Radio Networks , 2012, IEEE Communications Surveys & Tutorials.

[17]  Ekram Hossain,et al.  Pattern classification techniques for cooperative spectrum sensing in cognitive radio networks: SVM and W-KNN approaches , 2012, 2012 IEEE Global Communications Conference (GLOBECOM).

[18]  Husheng Li,et al.  Multi-agent Q-learning of channel selection in multi-user cognitive radio systems: A two by two case , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[19]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[20]  Jeffrey H. Reed,et al.  Metacognition: Enhancing the performance of a cognitive radio , 2011, 2011 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[21]  Ian F. Akyildiz,et al.  Reinforcement learning for cooperative sensing gain in cognitive radio ad hoc networks , 2013, Wirel. Networks.

[22]  Garrett M. Vanhoy,et al.  Cognitive radio testing using psychometric approaches: applicability and proof of concept study , 2012, Analog Integrated Circuits and Signal Processing.

[23]  Tomoaki Ohtsuki,et al.  Optimal channel-sensing policy based on Fuzzy Q-Learning process over cognitive radio systems , 2013, 2013 IEEE International Conference on Communications (ICC).

[24]  Arvin Agah,et al.  Cognitive engine implementation for wireless multicarrier transceivers , 2007, Wirel. Commun. Mob. Comput..

[25]  Bhaskar Krishnamachari,et al.  On myopic sensing for multi-channel opportunistic access: structure, optimality, and performance , 2007, IEEE Transactions on Wireless Communications.

[26]  Qian Zhang,et al.  Cooperative Boundary Detection for Spectrum Sensing Using Dedicated Wireless Sensor Networks , 2010, 2010 Proceedings IEEE INFOCOM.

[27]  Junde Song,et al.  Signal Classification Based on Spectral Correlation Analysis and SVM in Cognitive Radio , 2008, 22nd International Conference on Advanced Information Networking and Applications (aina 2008).

[28]  Michael M. Marefat,et al.  Metacognitive Radio Engine Design and Standardization , 2015, IEEE Journal on Selected Areas in Communications.

[29]  K. J. Ray Liu,et al.  Game theory for cognitive radio networks: An overview , 2010, Comput. Networks.

[30]  Preston Marshall Quantitative Analysis of Cognitive Radio and Network Performance , 2010, Mobile communications series.

[31]  Lie-Liang Yang,et al.  Zero-Forcing and Minimum Mean-Square Error Multiuser Detection in Generalized Multicarrier DS-CDMA Systems for Cognitive Radio , 2008, EURASIP J. Wirel. Commun. Netw..

[32]  Cheng Wu,et al.  Spectrum management of cognitive radio using multi-agent reinforcement learning , 2010, AAMAS.

[33]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[34]  Nicholas J. Kaminski,et al.  CSERE (Cognitive System Enabling Radio Evolution): A modular and user-friendly cognitive engine , 2012, 2012 IEEE International Symposium on Dynamic Spectrum Access Networks.

[35]  Shiwen Mao,et al.  Performance Evaluation of Cognitive Radios: Metrics, Utility Functions, and Methodology , 2009, Proceedings of the IEEE.

[36]  Kenneth M. Hopkinson,et al.  A Test Methodology for Evaluating Cognitive Radio Systems , 2015, IEEE Transactions on Wireless Communications.

[37]  Ari Hottinen,et al.  Optimizing Spatial and Temporal Reuse in Wireless Networks by Decentralized Partially Observable Markov Decision Processes , 2014, IEEE Transactions on Mobile Computing.

[38]  Yi Gai,et al.  Learning Multiuser Channel Allocations in Cognitive Radio Networks: A Combinatorial Multi-Armed Bandit Formulation , 2010, 2010 IEEE Symposium on New Frontiers in Dynamic Spectrum (DySPAN).

[39]  Wassim Jouini,et al.  Multi-armed bandit based policies for cognitive radio's decision making issues , 2009, 2009 3rd International Conference on Signals, Circuits and Systems (SCS).

[40]  Yonghong Zeng,et al.  Spectrum Sensing for Digital Primary Signals in Cognitive Radio: A Bayesian Approach for Maximizing Spectrum Utilization , 2013, IEEE Transactions on Wireless Communications.

[41]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..