论文信息 - GENERAL OPTIMAL STOPPING THE-OREMS FOR SEMI-MARKOV PROCESSES

GENERAL OPTIMAL STOPPING THE-OREMS FOR SEMI-MARKOV PROCESSES

In this paper, optimal stopping problems for semi-Markov processes are studied in a fairly general setting. In such a process transitions are made from state to state in accordance with a Markov chain, but the amount of time spent in each state is random. The times spent in each state follow a general renewal process. They may depend on the present state as well as on the state into which the next transition is made. Our goal is to maximize the expected net return, which is given as a function of the state at time t minus some cost function. Discounting may or may not be considered. The main theorems (Theorems 3.5 and 3.11) are expressions for the optimal stopping time in the undiscounted and discounted case. These theorems generalize results of Zuckerman [16] and Boshuizen and Gouweleeuw [3]. Applications are given in various special cases. The results developed in this paper can also be applied to semi-Markov shock

Frans A. Boshuizen | José M. Gouweleeuw

[1] P. Brémaud. Point processes and queues, martingale dynamics , 1983 .

[2] Steven A. Lippman,et al. Job search in a dynamic economy , 1976 .

[3] Edward P. C. Kao,et al. Optimal Replacement Rules when Changes of State are Semi-Markovian , 1973, Oper. Res..

[4] J. Neveu,et al. Discrete Parameter Martingales , 1975 .

[5] Wolfgang Stadje,et al. A new continuous-time search model , 1991, Journal of Applied Probability.

[6] P. Brémaud. Point Processes and Queues , 1981 .

[7] Terje Aven,et al. A COUNTING PROCESS APPROACH TO REPLACEMENT MODELS , 1987 .

[8] Mark H. A. Davis. The Representation of Martingales of Jump Processes , 1976 .

[9] Dror Zuckerman,et al. Job search: the continuous case , 1983, Journal of Applied Probability.

[10] Howard M. Taylor. Optimal replacement under additive damage and other failure models , 1975 .

[11] Dror Zuckerman,et al. Optimal stopping in a semi-Markov shock model , 1978 .

[12] L. Rogers,et al. Diffusions, Markov processes, and martingales , 1979 .

[13] R. M. Feldman. Optimal replacement with semi-Markov shock models , 1976 .