Load Shared Sequential Routing in MPLS Networks: System and User Optimal Solutions

Recently Gerald Ash has shown through case studies that event dependent routing is attractive in large scale multi-service MPLS networks. In this paper, we consider the application of Load Shared Sequential Routing (LSSR) in MPLS networks where the load sharing factors are updated using reinforcement learning techniques. We present algorithms based on learning automata techniques for optimizing the load sharing factors both from the user equilibrium and system optimum perspectives. To overcome the computationally expensive gradient evaluation associated with the Kuhn-Tucker conditions of the system optimum problem, we derive a computationally efficient method employing shadow prices. The proposed method for calculating the user equilibrium solution represents a computationally efficient alternative to discrete event simulation. Numerical results are presented for the performance comparison of the LSSR model with the user equilibrium and the system optimum load sharing factors in some example network topologies and traffic demands.

[1]  J. G. Wardrop,et al.  Some Theoretical Aspects of Road Traffic Research , 1952 .

[2]  Gerald R. Ash,et al.  Performance evaluation of QoS-routing methods for IP-based multiservice networks , 2003, Comput. Commun..

[3]  L. G. Mason,et al.  An optimal learning algorithm employing crosscorrelation , 1972 .

[4]  José-Luis Marzo,et al.  QoS online routing and MPLS multilevel protection: a survey , 2003, IEEE Commun. Mag..

[5]  M. Alanyali Learning automata in games with memory with application to circuit-switched routing , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[6]  L. G. Mason,et al.  Equilibrium flows, routing patterns and algorithms for store- and -forward networks , 1985 .

[7]  Desmond P. Taylor,et al.  A Minimum Delay Routing Algorithm Using Distributed Computation , 2007 .

[8]  R. Srikant,et al.  Computational techniques for accurate performance evaluation of multirate, multihop communication networks , 1995, SIGMETRICS '95/PERFORMANCE '95.

[9]  Wai Sum Lai,et al.  Requirements for Support of Differentiated Services-aware MPLS Traffic Engineering , 2003, RFC.

[10]  Frank P. Kelly,et al.  Effective bandwidths at multi-class queues , 1991, Queueing Syst. Theory Appl..

[11]  Lorne G. Mason,et al.  Adaptive isarithmic flow control in fast packet switching networks , 1995, IEEE Trans. Commun..

[12]  Vivek S. Borkar,et al.  Dynamic Cesaro-Wardrop equilibration in networks , 2003, IEEE Trans. Autom. Control..

[13]  Shie Mannor,et al.  Reinforcement Learning-Based Load Shared Sequential Routing , 2007, Networking.

[14]  G. Ash Traffic Engineering and QoS Optimization of Integrated Voice & Data Networks , 2006 .

[15]  Lorne G. Mason,et al.  Decentralized Adaptive Flow Control of High-Speed Connectionless Data Networks , 1999, Oper. Res..

[16]  J G Wardrop,et al.  CORRESPONDENCE. SOME THEORETICAL ASPECTS OF ROAD TRAFFIC RESEARCH. , 1952 .

[17]  L. Mason,et al.  An optimal learning algorithm for S-model environments , 1973 .