Sequential decision‐theoretic models and expert systems

Sequential decision models are an important component of expert systems since, in general, the cost of acquiring information is significant and there is a trade-off between the cost and the value of information. Many expert systems in various domains (business, engineering, medicine etc.), needing costly inputs that are not known until the system operates, have to face this problem. In the last decade the field of sequential decision models based on decision theory (sequential decision-theoretic models) have become more and more important due to both the continuous progress made by research in Bayesian networks and the availability of modern powerful tools for building Bayesian networks and for probability propagation. This paper provides readers (especially knowledge engineers and expert system designers) with a unified and integrated presentation of the disparate literature in the field of sequential decision-making based on decision theory, in order to improve comprehensibility and accessibility. Besides the presentation of the general theory, a view of sequential diagnosis as an instance of the general concept of sequential decision-theoretic models is also shown.

[1]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[2]  Jayant Kalagnanam,et al.  A comparison of decision alaysis and expert rules for sequential diagnosis , 2013, UAI.

[3]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[4]  Vijay S. Mookerjee,et al.  Sequential Decision Models for Expert System Optimization , 1997, IEEE Trans. Knowl. Data Eng..

[5]  David Heckerman,et al.  Probabilistic similarity networks , 1991, Networks.

[6]  Ross D. Shachter,et al.  Dynamic programming and influence diagrams , 1990, IEEE Trans. Syst. Man Cybern..

[7]  Ronald A. Howard,et al.  Information Value Theory , 1966, IEEE Trans. Syst. Sci. Cybern..

[8]  G. Gorry,et al.  Experience with a model of sequential diagnosis. , 2011, Computers and biomedical research, an international journal.

[9]  Elizabeth C. Hirschman,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[10]  Dominic A. Clark,et al.  Numerical and symbolic approaches to uncertainty management in AI , 1990, Artificial Intelligence Review.

[11]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems , 1988 .

[12]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[13]  D. Heckerman,et al.  Toward Normative Expert Systems: Part I The Pathfinder Project , 1992, Methods of Information in Medicine.

[14]  D E Heckerman,et al.  Toward Normative Expert Systems: Part II Probability-Based Representations for Efficient Knowledge Acquisition and Inference , 1992, Methods of Information in Medicine.