Multi‐level hierarchic Markov processes as a framework for herd management support

A general problem in relation to application of Markov decision processes to real world problems is the curse of dimensionality, since the size of the state space grows to prohibitive levels when information on all relevant traits of the system being modeled are included. In herd management, we face a hierarchy of decisions made at different levels with different time horizons, and the decisions made at different levels are mutually dependent. Furthermore, decisions have to be made without certainty about the future state of the system. These aspects contribute even further to the dimensionality problem. A new notion of a multi‐level hierarchic Markov process specially designed to solve dynamic decision problems involving decisions with varying time horizon has been presented. The method contributes significantly to circumvent the curse of dimensionality, and it provides a framework for general herd management support instead of very specialized models only concerned with a single decision as, for instance, replacement. The applicational perspectives of the technique are illustrated by potential examples relating to the management of a sow herd and a dairy herd.

[1]  Anders Ringgaard Kristensen,et al.  A Survey of Markov Decision Programming Techniques Applied to the Animal Replacement Problem , 1994 .

[2]  Ruud B.M. Huirne,et al.  Survey studies and experimental economic methods to investigate farmers decision making and profitability of management information systems. , 1994 .

[3]  Ronald A. Howard,et al.  Dynamic Programming and Markov Processes , 1960 .

[4]  Steffen L. Lauritzen,et al.  Representing and Solving Decision Problems with Limited Information , 2001, Manag. Sci..

[5]  Finn Verner Jensen,et al.  Introduction to Bayesian Networks , 2008, Innovations in Bayesian Networks.

[6]  James C. Cox,et al.  Quantifying the Effects of Sow‐Herd Management Information Systems on Farmers' Decision Making Using Experimental Economics , 1998 .

[7]  Ronald A. Howard,et al.  Dynamic Probabilistic Systems , 1971 .

[8]  Dina Notat.  Influence of price fluctuations on delivery strategies for slaughter pigs , 1998 .

[9]  Anders Ringgaard Kristensen.  Bayesian updating in hierarchic Markov processes applied to the animal replacement problem , 1993 .

[10]  Dina Kvl,et al.  Multi-level hierarchic Markov processes as a framework for herd management support , 1996 .

[11]  Anders Ringgaard Kristensen.  Maximization of Net Revenue per Unit of Physical Output in Markov Decision Processes , 1991 .

[12]  A R Kristensen,et al.  Optimal replacement of mastitic cows determined by a hierarchic Markov process. , 1994, Journal of dairy science.

[13]  Anders Ringgaard Kristensen.  Optimal Replacement and Ranking of Dairy Cows under Milk Quotas , 1989 .

[14]  Anders Ringgaard Kristensen.  Hierarchic Markov processes and their applications in replacement models , 1988 .

[15]  Erik Jørgensen,et al.  The Influence of Weighing Precision on Delivery Decisions in Slaughter Pig Production , 1993 .

[16]  Ruud B.M. Huirne,et al.  Economic modelling to optimize heifer management decisions with special reference to growth and fertility. , 1997 .

[17]  J. A. Arendonk,et al.  Studies on the replacement policies in dairy cattle. II. Optimum policy and influence of changes in production and prices , 1985 .

[18]  Anders Ringgaard Kristensen,et al.  Textbook notes of herd management: Dynamic programming and Markov decision processes , 2001 .

[19]  Anders Ringgaard Kristensen.  Optimal replacement and ranking of dairy cows determined by a hierarchic Markov process , 1987 .

[20]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[21]  Ruud B.M. Huirne,et al.  Evaluating management and management information systems using experimental economics. , 1996 .