A Markov Decision Process Model For Computer System Load Control

This paper combines a queueing network representation with a Markov decision process model to obtain optimal load control policies in a computer system with batch and interactive job classes. a pre...

[1]  Ronald A. Howard,et al.  Dynamic Programming and Markov Processes , 1960 .

[2]  Cyrus Derman,et al.  Finite State Markovian Decision Processes , 1970 .

[3]  P. Schweitzer.  Iterative solution of the functional equations of undiscounted Markov renewal programming , 1971 .

[4]  K. Mani Chandy,et al.  Open, Closed, and Mixed Networks of Queues with Different Classes of Customers , 1975, JACM.

[5]  J. Wal.  The method of value oriented successive approximations for the average reward Markov decision process , 1980 .

[6]  Hisao Kameda.  Effects of job loading policies for multiprogramming systems in processing a job stream , 1986, TOCS.

[7]  Peter J. Denning,et al.  An L=S criterion for optimal multiprogramming , 1976, SIGMETRICS '76.

[8]  Erol Gelenbe,et al.  Random Injection Control of Multiprogramming in Virtual Memory , 1976, IEEE Transactions on Software Engineering.

[9]  Peter J. Denning,et al.  Thrashing: its causes and prevention , 1968, AFIPS Fall Joint Computing Conference.

[10]  M. Puterman,et al.  Modified Policy Iteration Algorithms for Discounted Markov Decision Problems , 1978 .

[11]  Isi Mitrani,et al.  The control of response times in multi-class systems by memory allocation , 1979, CACM.

[12]  Donald D. Chamberlin,et al.  An analysis of page allocation strategies for multiprogramming systems with virtual memory , 1973 .

[13]  Sidney Addelman,et al.  trans-Dimethanolbis(1,1,1-trifluoro-5,5-dimethylhexane-2,4-dionato)zinc(II) , 2008, Acta crystallographica. Section E, Structure reports online.

[14]  Jeffrey P. Buzen,et al.  Computational algorithms for closed queueing networks with exponential servers , 1973, Commun. ACM.