Real Applications of Markov Decision Processes

In the first few years of an ongoing survey of applications of Markov decision processes where the results have been implemented or have had some influence on decisions, few applications have been identified where the results have been implemented but there appears to be an increasing effort to model many phenomena as Markov decision processes.

[1]  J. L. Fisher,et al.  Purchasing Raw Material on a Fluctuating Market , 1959 .

[2]  John F. Magee,et al.  Customer Behavior As a Markov Process , 1961 .

[3]  J. Lindqvist,et al.  Operation of a Hydrothermal Electric System: A Multistage Decision Process , 1962, Transactions of the American Institute of Electrical Engineers. Part III: Power Apparatus and Systems.

[4]  Peter Kolesar,et al.  A Markovian Model for Hospital Admission Scheduling , 1970 .

[5]  J. Buzacott,et al.  The Pit Charging Problem in Steel Production , 1973 .

[6]  B. H. Mahon,et al.  A Proposed Improved Replacement Policy for Army Vehicles , 1975 .

[7]  Arthur J. Swersey,et al.  Improving the Deployment of New York City Fire Companies , 1975 .

[8]  A. Haurie,et al.  On a suboptimal control of a hospital inpatient admission system , 1976 .

[9]  Ronald A. Howard,et al.  Comments on the Origin and Application of Markov Decision Processes , 2002, Oper. Res..

[10]  Carl J. Walters,et al.  SOME DYNAMIC PROGRAMMING APPLICATIONS IN FISHERIES MANAGEMENT , 1978 .

[11]  W. Boyce,et al.  Optimum Bond Calling and Refunding , 1979 .

[12]  M. Sniedovich.  Reliability‐constrained reservoir control problems: 1. Methodological issues , 1979 .

[13]  A. Haurie,et al.  On the control of care supply and demand in a urology department , 1980 .

[14]  C. Walters.  Optimum Escapements in the Face of Alternative Recruitment Hypotheses , 1981 .

[15]  C. A. Shoemaker,et al.  Applications of dynamic programming and other optimization methods in pest management , 1981 .

[16]  T. Kirkwood,et al.  Policy Analysis of Water Management for the Netherlands: Vol. XVII, Flood Safety Model for the IJssel Lakes , 1981 .

[17]  Arthur J. Swersey.  A Markovian Decision Model for Deciding How Many Fire Companies to Dispatch , 1982 .

[18]  J. H. Bigelow.  Policy analysis of water management for the Netherlands. Vol V: Design of managerial strategies , 1982 .

[19]  C. Walters,et al.  Optimal harvesting with imprecise parameter estimates , 1982 .

[20]  I. Meilijson,et al.  Incentive generating state dependent penalty system: The case of income tax evasion , 1982 .

[21]  Edward Ignall,et al.  An Algorithm for the Initial Dispatch of Fire Companies , 1982 .

[22]  Christine A. Shoemaker,et al.  Optimal Integrated Control of Univoltine Pest Populations with Age Structure , 1982, Oper. Res..

[23]  Kamal Golabi,et al.  A Statewide Pavement Management System , 1982 .

[24]  A. H. Murphy,et al.  Assessing the Value of Frost Forecasts to Orchardists: A Dynamic Decision-Making Approach , 1982 .

[25]  C. Shoemaker,et al.  Optimization Analysis of the Integration of Biological, Cultural, and Chemical Control of Alfalfa Weevil (Coleoptera: Curculionidae) , 1983 .

[26]  Chelsea C. White,et al.  A Simulation/optimization-based planning and decision support system , 1984, WSC '84.

[27]  C. Shoemaker,et al.  Management of alfalfa and the alfalfa Weevil (Hypera postica): An example of systems analysis in forage production , 1984 .

[28]  Roman Krzysztofowicz,et al.  Toward Improving Flood Forecast-Response Systems , 1984 .