The Use of Reinforcement Learning Algorithms in Traffic Control of High Speed Networks

Several approaches based on Computational Intelligence techniques that develop efficient solutions to some of the most significant traffic control problems of High Speed Networks have been proposed so far in the literature. In this chapter, using the experience obtained from already published works that regard the use of Reinforcement Learning Algorithms (RLA) in ATM networks, we try to form a general framework for encountering this kind of problems using RLA, making some general observations and remarks about the factors that affect considerably their performance, as well as classifying both the problems and the proposed solutions. Although this framework is developed using specific proposed mechanisms and Reinforcement Learning Algorithm, it can give some general but efficient guidelines that can be used irrespective of the RLA that is employed in each specific case, resulting in a better coping with this kind of problems.

[1]  Anastasios A. Economides,et al.  Decentralized adaptive routing for virtual circuit networks using stochastic learning automata , 1988, IEEE INFOCOM '88,Seventh Annual Joint Conference of the IEEE Computer and Communcations Societies. Networks: Evolution or Revolution?.

[2]  Athanasios V. Vasilakos,et al.  LB-SELA: Rate-Based Access Control for ATM Networks , 1998, Comput. Networks.

[3]  Debasis Mitra,et al.  Analysis and design of rate-based congestion control of high speed networks, I: stochastic fluid models, access regulation , 1991, Queueing Syst. Theory Appl..

[4]  G.I. Stassinopoulos,et al.  Leaky bucket mechanism with learning algorithm for ATM traffic policing , 1997, Proceedings Second IEEE Symposium on Computer and Communications.

[5]  Athanasios V. Vasilakos,et al.  A new approach to the design of reinforcement schemes for learning automata: Stochastic estimator learning algorithm , 1995, Neurocomputing.

[6]  W. J. Poppelbaum,et al.  Stochastic and deterministic averaging processors , 1981 .

[7]  Athanasios V. Vasilakos,et al.  The use of learning algorithms in ATM networks call admission control problem: a methodology , 1995, Proceedings of 20th Conference on Local Computer Networks.

[8]  Georgios I. Papadimitriou A New Approach to the Design of Reinforcement Schemes for Learning Automata: Stochastic Estimator Learning Algorithms , 1994, IEEE Trans. Knowl. Data Eng..

[9]  Athanasios V. Vasilakos,et al.  On the use of a stochastic estimator learning algorithm to the ATM routing problem: a methodology , 1998, Comput. Commun..

[10]  Gunnar Karlsson,et al.  Performance models of statistical multiplexing in packet video communications , 1988, IEEE Trans. Commun..

[11]  Hamid Ahmadi,et al.  Equivalent Capacity and Its Application to Bandwidth Allocation in High-Speed Networks , 1991, IEEE J. Sel. Areas Commun..