A Constructive Graphical Model Approach for Knowledge‐Based Systems: A Vehicle Monitoring Case Study

Graphical models have been widely applied to uncertain reasoning in knowledge‐based systems. For many of the problems tackled, a single graphical model is constructed before individual cases are presented and the model is used to reason about each new case. In this work, we consider a class of problems whose solution requires inference over a very large number of models that are impractical to construct a priori. We conduct a case study in the domain of vehicle monitoring and then generalize the approach taken. We show that the previously held negative belief on the applicability of graphical models to such problems is unjustified. We propose a set of techniques based on domain decomposition, model separation, model approximation, model compilation, and re‐analysis to meet the computational challenges imposed by the combinatorial explosion. Experimental results on vehicle monitoring demonstrated good performance at near‐real‐time.

[1]  Keiji Kanazawa,et al.  A model for reasoning about persistence and causation , 1989 .

[2]  Robert P. Goldman,et al.  Integrating Model Construction and Evaluation , 1992, UAI.

[3]  Enrique F. Castillo,et al.  Expert Systems and Probabilistic Network Models , 1996, Monographs in Computer Science.

[4]  Stuart J. Russell,et al.  Object Identification: A Bayesian Analysis with Application to Traffic Surveillance , 1998, Artif. Intell..

[5]  Edmund H. Durfee,et al.  Coordination of distributed problem solvers , 1988 .

[6]  D. Magill Optimal adaptive estimation of sampled stochastic processes , 1965 .

[7]  V. R. Lesser,et al.  Incremental planning to control time-constrained blackboard-based problem solver (vehicle monitoring) , 1988 .

[8]  John S. Breese,et al.  CONSTRUCTION OF BELIEF AND DECISION NETWORKS , 1992, Comput. Intell..

[9]  Bruce Abramson ARCO1: An Application of Belief Networks to the Oil Market , 1991, UAI.

[10]  Michael I. Jordan Graphical Models , 1998 .

[11]  Xavier Boyen,et al.  Discovering the Hidden Structure of Complex Dynamic Systems , 1999, UAI.

[12]  David Heckerman,et al.  A Tractable Inference Algorithm for Diagnosing Multiple Diseases , 2013, UAI.

[13]  Edmund H. Durfee,et al.  Incremental Planning to Control a Time-constrained, Blackboard-based , 1987 .

[14]  Cristina Conati,et al.  Procedural Help in Andes: Generating Hints Using a Bayesian Network Student Model , 1998, AAAI/IAAI.

[15]  Eugene Santos,et al.  A framework for building knowledge-bases under uncertainty , 1999, J. Exp. Theor. Artif. Intell..

[16]  Richard E. Neapolitan,et al.  Probabilistic reasoning in expert systems - theory and algorithms , 2012 .

[17]  Yang Xiang,et al.  Multiply sectioned Bayesian networks for neuromuscular diagnosis , 1993, Artif. Intell. Medicine.

[18]  David J. Spiegelhalter,et al.  Probabilistic Networks and Expert Systems , 1999, Information Science and Statistics.

[19]  Yaakov Bar-Shalom,et al.  Sonar tracking of multiple targets using joint probabilistic data association , 1983 .

[20]  Victor R. Lesser,et al.  Combining Approximate Front End Signal Processing with Selective Reprocessing in Auditory Perception , 1997, AAAI/IAAI.

[21]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .

[22]  Victor Lesser,et al.  A Framework for the Analysis of Sophisticated Control in Interpretation Systems , 1993 .

[23]  Michael P. Wellman,et al.  Planning and Control , 1991 .

[24]  Vladimir Pavlovic,et al.  Time-series classification using mixed-state dynamic Bayesian networks , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[25]  Avi Pfeffer,et al.  Object-Oriented Bayesian Networks , 1997, UAI.

[26]  Peter Haddawy,et al.  Generating Bayesian Networks from Probablity Logic Knowledge Bases , 1994, UAI.

[27]  Eric Horvitz,et al.  Structure and chance: melding logic and probability for software debugging , 1995, CACM.

[28]  David Poole,et al.  Probabilistic Horn Abduction and Bayesian Networks , 1993, Artif. Intell..

[29]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[30]  Y. Bar-Shalom Tracking and data association , 1988 .

[31]  Stuart J. Russell,et al.  The BATmobile: Towards a Bayesian Automated Taxi , 1995, IJCAI.

[32]  Victor R. Lesser,et al.  The Role of Data Reprocessing in Complex Acoustic Environments , 1998, AAAI/IAAI.

[33]  Victor R. Lesser,et al.  The Distributed Vehicle Monitoring Testbed: A Tool for Investigating Distributed Problem Solving Networks , 1983, AI Mag..

[34]  Robert P. Goldman,et al.  A Language for Construction of Belief Networks , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Gregory M. Provan,et al.  Query DAGs: A practical paradigm for implementing belief-network inference , 1996, UAI.

[36]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[37]  Victor R. Lesser,et al.  The Hearsay-II Speech-Understanding System: Integrating Knowledge to Resolve Uncertainty , 1980, CSUR.

[38]  Victor R. Lesser,et al.  A New Framework for Sensor Interpretation: Planning to Resolve Sources of Uncertainty , 1991, AAAI.

[39]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[40]  David Heckerman,et al.  Decision-theoretic troubleshooting , 1995, CACM.

[41]  David Poole,et al.  A Dynamic Approach to Probabilistic Inference using Bayesian Networks , 1990, UAI 1990.

[42]  Y. Bar-Shalom,et al.  Multiple-model estimation with variable structure , 1996, IEEE Trans. Autom. Control..

[43]  Kathryn B. Laskey,et al.  Constructing Situation Specific Belief Networks , 1998, UAI.

[44]  Yaakov Bar-Shalom,et al.  Multitarget-multisensor tracking: Advanced applications , 1989 .