Improving quality of data user experience in 4G distributed telecommunication systems

We propose an efficient service management technique that enhances the quality of experience (QoE) of 4G users by enabling them to locate the best available network service provider (NSP) among many existing NSPs. We also propose a practical method that 4G users can use to implement the proposed technique in a purely distributed manner. Using simulations, we show that the proposed technique i) increases network service availability by allowing 4G users to quickly find available NSPs, ii) are very scalable by performing well regardless of the number of users in the system, and iii) are implementable in decentralized fashion by relying on information that can be observed locally and without any cooperation.

[1]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[2]  Kagan Tumer,et al.  Distributed agent-based air traffic flow management , 2007, AAMAS '07.

[3]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[4]  Mingyan Liu,et al.  Optimality of Myopic Sensing in Multi-Channel Opportunistic Access , 2008, 2008 IEEE International Conference on Communications.

[5]  Hua Liu,et al.  Cooperation and Learning in Multiuser Opportunistic Spectrum Access , 2008, ICC Workshops - 2008 IEEE International Conference on Communications Workshops.

[6]  Qing Zhao,et al.  Distributed Learning in Multi-Armed Bandit With Multiple Players , 2009, IEEE Transactions on Signal Processing.

[7]  Bechir Hamdaoui Adaptive spectrum assessment for opportunistic access in cognitive radio networks , 2009, IEEE Transactions on Wireless Communications.

[8]  Kagan Tumer,et al.  Analyzing and visualizing multiagent rewards in dynamic and stochastic domains , 2008, Autonomous Agents and Multi-Agent Systems.

[9]  Venugopal V. Veeravalli,et al.  Algorithms for Dynamic Spectrum Access With Learning for Cognitive Radio , 2008, IEEE Transactions on Signal Processing.

[10]  Joseph Mitola,et al.  Cognitive radio: making software radios more personal , 1999, IEEE Wirel. Commun..

[11]  Mohsen Guizani,et al.  Opportunistic Bandwidth Sharing Through Reinforcement Learning , 2010, IEEE Transactions on Vehicular Technology.

[12]  Bechir Hamdaoui,et al.  Achieving optimal elastic traffic rewards in dynamic multichannel access , 2011, 2011 International Conference on High Performance Computing & Simulation.

[13]  R. I. Lackey,et al.  Speakeasy: the military software radio , 1995, IEEE Commun. Mag..

[14]  Kagan Tumer,et al.  Efficient Evaluation Functions for Evolving Coordination , 2008, Evolutionary Computation.

[15]  Bechir Hamdaoui,et al.  Efficient Objective Functions for Coordinated Learning in Large-Scale Distributed OSA Systems , 2013, IEEE Transactions on Mobile Computing.

[16]  Bhaskar Krishnamachari,et al.  Dynamic Multichannel Access With Imperfect Channel State Detection , 2010, IEEE Transactions on Signal Processing.

[17]  Kagan Tumer,et al.  Collectives and Design Complex Systems , 2004 .

[18]  Lang Tong,et al.  Optimal Cognitive Access of Markovian Channels under Tight Collision Constraints , 2011, IEEE J. Sel. Areas Commun..

[19]  Fangwen Fu,et al.  Detection of Spectral Resources in Cognitive Radios Using Reinforcement Learning , 2008, 2008 3rd IEEE Symposium on New Frontiers in Dynamic Spectrum Access Networks.

[20]  Qing Zhao,et al.  Decentralized dynamic spectrum access for cognitive radios: cooperative design of a non-cooperative game , 2009, IEEE Transactions on Communications.

[21]  Kagan Tumer,et al.  Multi-agent reward analysis for learning in noisy domains , 2005, AAMAS '05.

[22]  Bechir Hamdaoui,et al.  Enabling opportunistic and dynamic spectrum access through learning techniques , 2011, Wirel. Commun. Mob. Comput..