Learning-Based QoS Control Algorithms for Next Generation Internet of Things

The Internet has become an evolving entity, growing in importance and creating new value through its expansion and added utilization. The Internet of Things (IoT) is a new concept associated with the future Internet and has recently become popular in a dynamic and global network infrastructure. However, in an IoT implementation, it is difficult to satisfy different Quality of Service (QoS) requirements and achieve rapid service composition and deployment. In this paper, we propose a new QoS control scheme for IoT systems. Based on the Markov game model, the proposed scheme can effectively allocate IoT resources while maximizing system performance. In multiagent environments, a game theory approach can provide an effective decision-making framework for resource allocation problems. To verify the results of our study, we perform a simulation and confirm that the proposed scheme can achieve considerably improved system performance compared to existing schemes.

[1]  Peter Vrancx,et al.  Decentralized Learning in Markov Games , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  Hyunsoo Yoon,et al.  A Survey on Communication Protocols for Wireless Sensor Networks , 2013, J. Comput. Sci. Eng..

[3]  Guy Pujolle Metamorphic Networks , 2013, J. Comput. Sci. Eng..

[4]  Xiong Luo,et al.  Online Optimization of Collaborative Web Service QoS Prediction Based on Approximate Dynamic Programming , 2014, 2014 International Conference on Identification, Information and Knowledge in the Internet of Things.

[5]  Tonny Bulega,et al.  Resource sharing between M2M and H2H traffic under time-controlled scheduling scheme in LTE networks , 2014, 2014 8th International Conference on Telecommunication Systems Services and Applications (TSSA).

[6]  Gyula Sallai,et al.  Chapters of Future Internet research , 2013, 2013 IEEE 4th International Conference on Cognitive Infocommunications (CogInfoCom).

[7]  Ling Li,et al.  QoS-Aware Scheduling of Services-Oriented Internet of Things , 2014, IEEE Transactions on Industrial Informatics.

[8]  Qihui Wu,et al.  Cognitive Internet of Things: A New Paradigm Beyond Connection , 2014, IEEE Internet of Things Journal.

[9]  J. Wal Discounted Markov games; successive approximation and stopping times , 1977 .

[10]  Qi Zhang,et al.  Intelligent Decision-Making Service Framework Based on QoS Model in the Internet of Things , 2012, 2012 11th International Symposium on Distributed Computing and Applications to Business, Engineering & Science.

[11]  Kevin Ashton,et al.  That ‘Internet of Things’ Thing , 1999 .

[12]  Kyong-Ho Lee,et al.  IoT Service Selection Based on Physical Service Model and Absolute Dominance Relationship , 2014, 2014 IEEE 7th International Conference on Service-Oriented Computing and Applications.

[13]  Sungwook Kim,et al.  Adaptive Ad-hoc Network Routing Scheme by Using Incentive-based Model , 2012, Ad Hoc Sens. Wirel. Networks.