Multi-Armed Bandit Channel Access Scheme With Cognitive Radio Technology in Wireless Sensor Networks for the Internet of Things

The wireless sensor network (WSN) is one of the key enablers for the Internet of Things (IoT), where WSNs will play an important role in future internet by several application scenarios, such as healthcare, agriculture, environment monitoring, and smart metering. However, today's radio spectrum is very crowded for the rapid increasing popularities of various wireless applications. Hence, WSN utilizing the advantages of cognitive radio technology, namely, cognitive radio-based WSN (CR-WSN), is a promising solution for spectrum scarcity problem of IoT applications. A major challenge in CR-WSN is utilizing spectrum more efficiently. Therefore, a novel channel access scheme is proposed for the problem that how to access the multiple channels with the unknown environment information for cognitive users, so as to maximize system throughput. The problem is modeled as I.I.D. multi-armed bandit model with M cognitive users and N arms (M<;N). In order to solve the competition and the fairness between cognitive users of WSNs, a fair channel-grouping scheme is proposed. The proposed scheme divides these channels into M groups according to the water-filling principle based on the learning algorithm UCB-K index, the number of channels not less than one in each group and then allocate channel group for each cognitive user by using distributed learning algorithm fairly. Finally, the experimental results demonstrate that the proposed scheme cannot only effectively solve the problem of collision between the cognitive users, improve the utilization rate of the idle spectrum, and at the same time reflect the fairness of selecting channels between cognitive users.

[1]  Jianxiong Zhou,et al.  A Low-Power and Portable Biomedical Device for Respiratory Monitoring with a Stable Power Source , 2015, Sensors.

[2]  Zhihan Lv,et al.  Multimedia cloud transmission and storage system based on internet of things , 2017, Multimedia Tools and Applications.

[3]  Dingde Jiang,et al.  Joint time-frequency sparse estimation of large-scale network traffic , 2011, Comput. Networks.

[4]  Yi Gai,et al.  Decentralized Online Learning Algorithms for Opportunistic Spectrum Access , 2011, 2011 IEEE Global Telecommunications Conference - GLOBECOM 2011.

[5]  Elias Yaacoub,et al.  Cooperative wireless sensor networks for green internet of things , 2012, Q2SWinet '12.

[6]  Jing Shi,et al.  Wireless Sensor Network Technology and Its Application Potentials for Service Innovation in Supply Chain Management , 2010, Int. J. Appl. Logist..

[7]  Richard Demo Souza,et al.  Rate and Energy Efficient Power Control in a Cognitive Radio Ad Hoc Network , 2013, IEEE Signal Processing Letters.

[8]  Lu Zhao,et al.  An Adaptive Opportunistic Network Coding Mechanism in Wireless Multimedia Sensor Networks , 2012, Int. J. Distributed Sens. Networks.

[9]  Tor André Myrvoll,et al.  Dynamic Spectrum Access in realistic environments using reinforcement learning , 2012, 2012 International Symposium on Communications and Information Technologies (ISCIT).

[10]  Geoffrey G. Messier,et al.  Traffic models for medical wireless sensor networks , 2007, IEEE Communications Letters.

[11]  Qing Zhao,et al.  Distributed Learning in Multi-Armed Bandit With Multiple Players , 2009, IEEE Transactions on Signal Processing.

[12]  Yan Chen,et al.  On cognitive radio networks with opportunistic power control strategies in fading channels , 2008, IEEE Transactions on Wireless Communications.

[13]  Victor C. M. Leung,et al.  Rank-optimal channel selection strategy in cognitive networks , 2012, 2012 IEEE Global Communications Conference (GLOBECOM).

[14]  Hesham A. Ali,et al.  Image compression algorithms in wireless multimedia sensor networks: A survey , 2015 .

[15]  Qing Zhao,et al.  Distributed learning in cognitive radio networks: Multi-armed bandit with distributed multiple players , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  Min Dong,et al.  Decentralized spectrum learning and access adaptive to channel availability distribution in primary network , 2013, 2013 IEEE 14th Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[17]  Mohd Fauzi Othman,et al.  Wireless Sensor Network Applications: A Study in Environment Monitoring System , 2012 .

[18]  Cristina Alcaraz,et al.  Key management systems for sensor networks in the context of the Internet of Things , 2011, Comput. Electr. Eng..

[19]  Dingde Jiang,et al.  A collaborative multi-hop routing algorithm for maximum achievable rate , 2015, J. Netw. Comput. Appl..

[20]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[21]  Mihaela van der Schaar,et al.  Autonomic and Distributed Joint Routing and Power Control for Delay-Sensitive Applications in Multi-Hop Wireless Networks , 2011, IEEE Transactions on Wireless Communications.

[22]  K. J. Ray Liu,et al.  Advances in cognitive radio networks: A survey , 2011, IEEE Journal of Selected Topics in Signal Processing.

[23]  Setareh Maghsudi,et al.  Hybrid Centralized–Distributed Resource Allocation for Device-to-Device Communication Underlaying Cellular Networks , 2015, IEEE Transactions on Vehicular Technology.

[24]  Wenhui Zhao,et al.  An optimization-based robust routing algorithm to energy-efficient networks for cloud computing , 2015, Telecommunication Systems.

[25]  Slawomir Stanczak,et al.  Cognitive Wireless Communications – A paradigm shift in dealing with radio resources as a prerequisite for the wireless network of the future – An overview on the topic of cognitive wireless technologies , 2016 .

[26]  Ying Sun,et al.  Design of Medical Wireless Sensor Network , 2011 .

[27]  Naumaan Nayyar,et al.  Decentralized Learning for Multiplayer Multiarmed Bandits , 2014, IEEE Transactions on Information Theory.

[28]  Luca Mainetti,et al.  Evolution of wireless sensor networks towards the Internet of Things: A survey , 2011, SoftCOM 2011, 19th International Conference on Software, Telecommunications and Computer Networks.

[29]  Jianxiong Zhou,et al.  A Real-Time Monitoring System of Industry Carbon Monoxide Based on Wireless Sensor Networks , 2015, Sensors.

[30]  Jing Shi,et al.  Impact of Wireless Sensor Network Technology on Service Innovation in Supply Chain Management , 2010 .

[31]  Alexandre Proutière,et al.  Spectrum bandit optimization , 2013, 2013 IEEE Information Theory Workshop (ITW).

[32]  Enzo Baccarelli,et al.  P-SEP: a prolong stable election routing algorithm for energy-limited heterogeneous fog-supported wireless sensor networks , 2017, The Journal of Supercomputing.

[33]  Fotis Liarokapis,et al.  Augmented Reality Environmental Monitoring Using Wireless Sensor Networks , 2008, 2008 12th International Conference Information Visualisation.

[34]  Lang Tong,et al.  Multi-channel opportunistic spectrum access in unslotted primary systems with unknown models , 2011, 2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[35]  Alagan Anpalagan,et al.  Opportunistic Spectrum Access in Unknown Dynamic Environment: A Game-Theoretic Stochastic Learning Solution , 2012, IEEE Transactions on Wireless Communications.

[36]  Hyun Yoe,et al.  Study on an Agricultural Environment Monitoring Server System using Wireless Sensor Networks , 2010, Sensors.

[37]  Jianjun Tan,et al.  Intelligent photovoltaic monitoring based on solar irradiance big data and wireless sensor networks , 2015, Ad Hoc Networks.

[38]  Bin He,et al.  Big Data Reduction and Optimization in Sensor Monitoring Network , 2014, J. Appl. Math..

[39]  Lijun Qian,et al.  Distributed Energy Efficient Spectrum Access in Wireless Cognitive Radio Sensor Networks , 2008, 2008 IEEE Wireless Communications and Networking Conference.

[40]  Ananthram Swami,et al.  Distributed Algorithms for Learning and Cognitive Medium Access with Logarithmic Regret , 2010, IEEE Journal on Selected Areas in Communications.

[41]  Xiaoqing Yu,et al.  Virtual reality platform for smart city based on sensor network and OSG engine , 2012, 2012 International Conference on Audio, Language and Image Processing.

[42]  Enzo Baccarelli,et al.  Distributed and adaptive resource management in Cloud-assisted Cognitive Radio Vehicular Networks with hard reliability guarantees , 2015, Veh. Commun..

[43]  Sattar Vakili,et al.  Deterministic Sequencing of Exploration and Exploitation for Multi-Armed Bandit Problems , 2011, IEEE Journal of Selected Topics in Signal Processing.

[44]  Dingde Jiang,et al.  Network coding-based energy-efficient multicast routing algorithm for multi-hop wireless networks , 2015, J. Syst. Softw..

[45]  Peng Zhang,et al.  A transform domain-based anomaly detection approach to network-wide traffic , 2014, J. Netw. Comput. Appl..

[46]  Dingde Jiang,et al.  An effective dynamic spectrum access algorithm for multi-hop cognitive wireless networks , 2015, Comput. Networks.

[47]  Zhihan Lv,et al.  A Self-Assessment Stereo Capture Model Applicable to the Internet of Things , 2015, Sensors.

[48]  Ian F. Akyildiz,et al.  A survey on wireless multimedia sensor networks , 2007, Comput. Networks.

[49]  Yi Gai,et al.  Distributed Stochastic Online Learning Policies for Opportunistic Spectrum Access , 2014, IEEE Transactions on Signal Processing.

[50]  T. Gulrez,et al.  Precision Position Tracking in Virtual Reality Environments using Sensor Networks , 2007, 2007 IEEE International Symposium on Industrial Electronics.