Market Model for Resource Allocation in Emerging Sensor Networks with Reinforcement Learning

Emerging sensor networks (ESNs) are an inevitable trend with the development of the Internet of Things (IoT), and intend to connect almost every intelligent device. Therefore, it is critical to study resource allocation in such an environment, due to the concern of efficiency, especially when resources are limited. By viewing ESNs as multi-agent environments, we model them with an agent-based modelling (ABM) method and deal with resource allocation problems with market models, after describing users’ patterns. Reinforcement learning methods are introduced to estimate users’ patterns and verify the outcomes in our market models. Experimental results show the efficiency of our methods, which are also capable of guiding topology management.

[1]  F. Richard Yu,et al.  An Energy-Efficient Resource Allocation and Interference Management Scheme in Green Heterogeneous Networks Using Game Theory , 2016, IEEE Transactions on Vehicular Technology.

[2]  Henk A. P. Blom,et al.  Agent-Based Modeling and Simulation of Coordination by Airline Operations Control , 2016, IEEE Transactions on Emerging Topics in Computing.

[3]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[4]  Waqar Mahmood,et al.  Internet of multimedia things: Vision and challenges , 2015, Ad Hoc Networks.

[5]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[6]  Zaher Dawy,et al.  Social Network Aware Device-to-Device Communication in Wireless Networks , 2015, IEEE Transactions on Wireless Communications.

[7]  Leandros A. Maglaras,et al.  Social Internet of Vehicles for Smart Cities , 2016, J. Sens. Actuator Networks.

[8]  Yonggang Wen,et al.  Toward Scalable Systems for Big Data Analytics: A Technology Tutorial , 2014, IEEE Access.

[9]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[10]  Abdulmotaleb El-Saddik,et al.  Toward Social Internet of Vehicles: Concept, Architecture, and Applications , 2015, IEEE Access.

[11]  Ian F. Akyildiz,et al.  Sensor Networks , 2002, Encyclopedia of GIS.

[12]  Yue Zhang,et al.  Social vehicle swarms: a novel perspective on socially aware vehicular communication architecture , 2016, IEEE Wireless Communications.

[13]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[14]  Laurence T. Yang,et al.  Energy-Efficient Resource Allocation for D2D Communications Underlaying Cloud-RAN-Based LTE-A Networks , 2016, IEEE Internet of Things Journal.

[15]  Chunxiao Jiang,et al.  Information Security in Big Data: Privacy and Data Mining , 2014, IEEE Access.

[16]  Sneha A. Dalvi,et al.  Internet of Things for Smart Cities , 2017 .

[17]  Sherali Zeadally,et al.  Intelligent Device-to-Device Communication in the Internet of Things , 2016, IEEE Systems Journal.

[18]  Octavia A. Dobre,et al.  Radio Resource Allocation Techniques for Efficient Spectrum Access in Cognitive Radio Networks , 2016, IEEE Communications Surveys & Tutorials.

[19]  Sunggu Lee,et al.  A Free Market Economy Model for Resource Management in Wireless Sensor Networks , 2015 .

[20]  Antonio Iera,et al.  The Social Internet of Things (SIoT) - When social networks meet the Internet of Things: Concept, architecture and network characterization , 2012, Comput. Networks.

[21]  E. S. Mundhe.  TEN PRINCIPLES OF ECONOMICS , 2016 .

[22]  Kyung-Sup Kwak,et al.  The Internet of Things for Health Care: A Comprehensive Survey , 2015, IEEE Access.

[23]  Athanasios V. Vasilakos,et al.  Trustworthy data fusion and mining in Internet of Things , 2015, Future Gener. Comput. Syst..