QoS-aware heterogeneous networking using distributed multiagent schemes

This study achieves Quality-of-Service (QoS) management in heterogeneous networking using a distributed multi-agent scheme (DMAS) based on the concept of cooperation and the awareness algorithm. The proposed scheme is developed for supporting QoS management in a user-accepted and cost-effective fashion, which consists of a collection of problem-solving agents with three modules: the knowledge source, the in-cloud blackboard system, and the control engine built into the scheme. A set of problem-solving agents autonomously process local tasks and cooperatively interoperate via an in-cloud blackboard system to guarantee QoS. An awareness algorithm, called the Q-learning algorithm, calculates the exceptive rewards of a handoff to all access networks. These rewards are then used by these problem-solving agents to determine what to do. Through operations and cooperation among the active agents, a policy is selected and a user-accepted schedule that meets the specified QoS is generated. Compared with traditional QoS management mechanisms, the proposed DMAS scheme has a 36% lower packet loss ratio in video streaming applications and a 34% lower average delay in VoIP applications with only a minor sacrifice in system computational complexity.

[1]  Jiann-Liang Chen,et al.  Communication Networks Adaptive radio resource management in an integrated GPRS/UMTS service network , 2008, Eur. Trans. Telecommun..

[2]  K. A. De Jong,et al.  Evolving intelligent agents: A 50 year quest , 2008, IEEE Comput. Intell. Mag..

[3]  Chi Sun,et al.  A Constrained MDP-Based Vertical Handoff Decision Algorithm for 4G Wireless Networks , 2008, ICC 2008.

[4]  Vincent W. S. Wong,et al.  A Vertical Handoff Decision Algorithm for Heterogeneous Wireless Networks , 2007, 2007 IEEE Wireless Communications and Networking Conference.

[5]  Mihaela van der Schaar,et al.  A New Systematic Framework for Autonomous Cross-Layer Optimization , 2009, IEEE Transactions on Vehicular Technology.

[6]  Jiann-Liang Chen.  Resource allocation for cellular data services using multiagent schemes , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[7]  C. Siva Ram Murthy,et al.  A Reinforcement Learning Framework for Path Selection and Wavelength Selection in Optical Burst Switched Networks , 2007, IEEE Journal on Selected Areas in Communications.

[8]  Vincent W. S. Wong,et al.  Comparison between Vertical Handoff Decision Algorithms for Heterogeneous Wireless Networks , 2006, 2006 IEEE 63rd Vehicular Technology Conference.

[9]  H. Hodzic,et al.  QoS architecture in IP multimedia subsystem of UMTS , 2008, 2008 50th International Symposium ELMAR.

[10]  Vincent W. S. Wong,et al.  A Constrained MDP-Based Vertical Handoff Decision Algorithm for 4G Wireless Networks , 2008, 2008 IEEE International Conference on Communications.

[11]  Vincent W. S. Wong,et al.  An MDP-Based Vertical Handoff Decision Algorithm for Heterogeneous Wireless Networks , 2008, IEEE Transactions on Vehicular Technology.

[12]  Oriol Sallent,et al.  A Markovian Approach to Radio Access Technology Selection in Heterogeneous Multiaccess/Multiservice Wireless Networks , 2008, IEEE Transactions on Mobile Computing.

[13]  Samir Chopra,et al.  Rights for autonomous artificial agents? , 2010, Commun. ACM.

[14]  Jiann-Liang Chen,et al.  Adaptive Radio Resource Scheduling in an Integrated GPRS/UMTS Service Network , 2006, Wireless and Optical Communications.

[15]  Zhu Han,et al.  Distributed Energy-Efficient Cooperative Routing in Wireless Networks , 2007, IEEE GLOBECOM 2007 - IEEE Global Telecommunications Conference.