Stochastic Hybrid Netcad Systems for Modeling Call Admission and Routing control in Networks

Abstract In this paper a stochastic hybrid systems framework is established for the formulation of call admission control (CAC) and routing control (RC) problems in networks. The hybrid state process of the underlying system is a piecewise deterministic Markovian process (PDMP) evolving deterministically between random event instants at which times the state jumps to another state value. The random events in the system correspond to the arrival of call requests or the departure of connections. The resulting NETCAD stochastic state space systems framework permits the formulation and analysis of centralized optimal stochastic control with respect to specified utility functions [3,8,10,11].

[1]  V. Benes,et al.  Mathematical Theory of Connecting Networks and Telephone Traffic. , 1966 .

[2]  John N. Tsitsiklis,et al.  Call admission control and routing in integrated services networks using neuro-dynamic programming , 2000, IEEE Journal on Selected Areas in Communications.

[3]  Zhongjing Ma,et al.  Stochastic Control of Network Systems II: NETCAD Optimal Control & the HJB Equation , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[4]  Zbigniew Dziong,et al.  Call admission and routing in multi-service loss networks , 1994, IEEE Trans. Commun..

[5]  Frank Kelly.  Dynamic Routing in Stochastic Networks , 1995 .

[6]  Peter E. Caines,et al.  On the optimal control of hybrid systems: analysis and zonal algorithms for trajectory and schedule optimization , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[7]  P. Varaiya,et al.  Optimal Control of Jump Processes , 1977 .

[8]  Mark H. Davis.  Markov Models and Optimization , 1995 .

[9]  Zhongjing Ma,et al.  Stochastic Control of Network Systems I: NETCAD State Space Structure & Dynamics , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.