On the Maximum Average Throughput Rate for a Tandem Node Network

The problem of regulating inputs into a tandem store-and-forward node pair with finite queue limits in order to maximize the average message completion rate is considered from the viewpoint of Markov Decision Theory. A variation of the policy iteration procedure due to Howard [3] is used to compute optimum control policies and message completion rates for various configurations of system parameters. Comparative data are provided on the performance of the optimum control law relative to simpler local control laws which require no information sharing.

[1]  Pravin Varaiya,et al.  Optimal control of Markovian jump processes , 1975, 1975 IEEE Conference on Decision and Control including the 14th Symposium on Adaptive Processes.

[2]  Leonard Kleinrock,et al.  Communication Nets: Stochastic Message Flow and Delay , 1964 .

[3]  Ronald A. Howard,et al.  Dynamic Probabilistic Systems , 1971 .