A Genetic Based Fuzzy Q-Learning Flow Controller for High-Speed Networks

For the congestion problems in high-speed networks, a genetic based fuzzy Q-learning flow controller is proposed. Because of the uncertainties and highly time-varying, it is not easy to accurately obtain the complete information for high-speed networks. In this case, the Q-learning, which is independent of mathematic model, and prior-knowledge, has good performance. The fuzzy inference is introduced in order to facilitate generalization in large state space, and the genetic operators are used to obtain the consequent parts of fuzzy rules. Simulation results show that the proposed controller can learn to take the best action to regulate source flow with the features of high throughput and low packet loss ratio, and can avoid the occurrence of congestion effectively.

[1]  Andreas Pitsillides,et al.  Adaptive congestion protocol: A congestion control protocol with learning capability , 2007, Comput. Networks.

[2]  Yuanwei Jing,et al.  Metropolis Criterion Based Q-Learning Flow Control for High-Speed Networks , 2008 .

[3]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[4]  Chung-Ju Chang,et al.  A QoS-Provisioning neural fuzzy connection admission controller for multimedia high-speed networks , 1999, TNET.

[5]  Xiaojun Shen,et al.  Simulated annealing-reinforcement learning algorithm for ABR traffic control of ATM networks , 2007, 2007 46th IEEE Conference on Decision and Control.

[6]  Yi Zhou,et al.  A Hybrid Approach for Automatic Generation of Fuzzy Inference Systems without Supervised Learning , 2007, 2007 American Control Conference.

[7]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[8]  Günhan Dündar,et al.  Hierarchical neuro-fuzzy call admission controller for ATM networks , 2001, Comput. Commun..

[9]  Erfu Yang,et al.  A Policy Grad Grad Grad Grad ient Reinforcement Learning Algorithm with Fuzzy Function Approximation , 2004, 2004 IEEE International Conference on Robotics and Biomimetics.

[10]  Michael L. Littman,et al.  Value-function reinforcement learning in Markov games , 2001, Cognitive Systems Research.

[11]  Kao-Shing Hwang,et al.  A REINFORCEMENT LEARNING APPROACH TO CONGESTION CONTROL OF HIGH-SPEED MULTIMEDIA NETWORKS , 2005, Cybern. Syst..

[12]  Stewart W. Wilson.  Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.

[13]  Kao-Shing Hwang,et al.  Cooperative multiagent congestion control for high-speed networks , 2005, IEEE Trans. Syst. Man Cybern. Part B.

[14]  Jon Crowcroft,et al.  Congestion control mechanisms and the best effort service model , 2001, IEEE Netw..