A Context-Partitioned Stochastic Modeling System with Causally Informed Context Management and Model Induction

We describe a flexible multi-layer architecture for contextsensitive stochastic modeling. The architecture incorporates a high performance stochastic modeling core based on a recursive form of probabilistic logic. On top of this modeling core, causal representations and reasoning direct a long-term incremental learning process that produces a context-partitioned library of stochastic models. The failure-driven learning procedure for expanding and refining the model library employs a combination of abductive inference together with EM model induction to construct new models when current models no longer perform acceptably. The system uses a causal finite state machine representation to control on-line model switching and model adaptation along with embedded learning. Our system is designed to support operational deployment in real-time monitoring, diagnostic, prognostic, and decision support applications. In this paper we describe the basic multi-layer architecture along with new learning algorithms inspired by developmental learning theory.

[1]  S. Brodetsky Essai philosophique sur les probabilités , 1922, Nature.

[2]  Luc De Raedt,et al.  Bayesian Logic Programs , 2001, ILP Work-in-progress reports.

[3]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[4]  P Haddawy,et al.  Efficient temporal probabilistic reasoning via context-sensitive model construction , 1997, Comput. Biol. Medicine.

[5]  Jean Piaget Piaget’s Theory , 1976 .

[6]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[7]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[8]  N. Granott,et al.  Microdevelopment: Transition Processes in Development and Learning , 2009 .

[9]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[10]  Kurt W. Fischer,et al.  Microdevelopment: Bridging to the unknown: A transition mechanism in learning and development , 2002 .

[11]  Peter Haddawy,et al.  Generating Bayesian Networks from Probablity Logic Knowledge Bases , 1994, UAI.

[12]  David M. Sobel,et al.  A theory of causal learning in children: causal maps and Bayes nets. , 2004, Psychological review.

[13]  Nikita A. Sakhanenko,et al.  Managing Dynamic Contexts Using Failure-Driven Stochastic Models , 2007, FLAIRS Conference.

[14]  George F. Luger,et al.  Abduction and abstraction in diagnosis: a schema-based account , 1997 .

[15]  Lise Getoor,et al.  Learning Probabilistic Relational Models , 1999, IJCAI.

[16]  Peter Haddawy,et al.  Answering Queries from Context-Sensitive Probabilistic Knowledge Bases (cid:3) , 1996 .

[17]  Joseph Y. Halpern,et al.  Causes and Explanations: A Structural-Model Approach. Part I: Causes , 2000, The British Journal for the Philosophy of Science.

[18]  David B. Leake Abduction, experience, and goals: a model of everyday abductive explanation , 1995, J. Exp. Theor. Artif. Intell..