Research on Markov Delay Characteristic-Based Closed Loop Network Control System

Aiming at the stochastic transfer delay inherently existing in the control network, a novel control pattern is proposed, which implements the modeling of the network control system with multi_step stochastic transfer delay. Based on this model, utilizing Markov chain theory, the stochastic optimal control law satisfying the pre_specified performance index is obtained. Also the method calculating the corresponding Markov state transition matrix is given. Experimental results show the correctness and the validity of the proposed theory.