Stochastic analysis of a non-homogeneous Markov system

Abstract 3 stochastic analysis on the non-homogeneous Markov system is outlined firstly in this paper. A method is given for computing the expectations and central quadratic moments of the number of individuals in the various classes at discrete points of time. We also discuss the probability of attaining goal-structures and paths using recruitment control. Finally an illustration is provided of the present results in a manpower system

[1]  John L. Casti,et al.  Principles of Dynamic Programming: Advanced Theory and Applications , 1982 .

[2]  David J. Bartholomew,et al.  Stochastic Models for Social Processes. , 1969 .

[3]  D. J. Bartholomew.  Maintaining a grade or age structure in a stochastic environment , 1977 .

[4]  P.-C. G. Vassiliou,et al.  Asymptotically Attainable Structures in Nonhomogeneous Markov Systems , 1990, Oper. Res..

[5]  P.-C. G. Vassiliou,et al.  The non homogeneous semi-Markov system in a stochastic environment , 1993 .

[6]  G. S. Davies.  Control of grade sizes in a partially stochastic Markov manpower model , 1982 .

[7]  M. J. D. Powell,et al.  A tolerant algorithm for linearly constrained optimization calculations , 1989, Math. Program..

[8]  Andreas C. Georgiou,et al.  Partial maintainability and control in nonhomogeneous Markov manpower systems , 1992 .

[9]  P.-C. G. Vassiliou,et al.  Control of asymptotic variability in non-homogeneous Markov systems , 1990, Journal of Applied Probability.

[10]  J. H. Pollard,et al.  On the use of the direct matrix product in analysing certain stochastic population models , 1966 .

[11]  P. Vassiliou.  Cyclic behaviour and asymptotic stability of non-homogeneous Markov systems , 1984, Journal of Applied Probability.

[12]  P.-C. G. Vassiliou,et al.  Asymptotic variability of nonhomogeneous Markov systems under cyclic behaviour , 1986 .

[13]  M. Schervish.  Multivariate normal probabilities with error bound , 1984 .

[14]  P.-C. G. Vassiliou,et al.  Non-homogeneous semi-Markov systems and maintainability of the state sizes , 1992 .

[15]  Averill M. Law,et al.  The art and theory of dynamic programming , 1977 .

[16]  P.-C. G. Vassiliou,et al.  Asymptotic behavior of Markov systems , 1982, Journal of Applied Probability.

[17]  D. J. Bartholomew,et al.  The control of a grade structure in a stochastic environment using promotion control , 1979, Advances in Applied Probability.

[18]  G. Abdallaoui,et al.  Probability of maintaining or attaining a structure in one step , 1987, Journal of Applied Probability.

[19]  Limiting second moments for transient states of Markov chains , 1973 .

[20]  Sally McClean,et al.  Statistical Techniques for Manpower Planning. , 1980 .

[21]  P. Vassiliou,et al.  Asymptotic periodicity of the variances and covariances of the state sizes in non-homogeneous Markov systems , 1988, Journal of Applied Probability.