Integrating statistical methods for characterizing causal influences on planner behavior over time

Statistical causal modeling techniques allow us to develop models of program behavior, but these techniques tend to be limited in what they can model: either continuing, repetitive influences or causal influences without cycles, but not both as appear in many environments. The paper describes how two statistical modeling techniques can be combined to suggest and test specific hypotheses about how the environment and the AI planner's design causally influence the planner's behavior. One technique, dependency detection, is designed to identify relationships (dependencies) between particular failures, the methods that repair them and the occurrence of failures downstream. Another method, path analysis, builds causal models of correlational data. Dependency detection operates over a series of events, and path analysis models within a temporal snapshot. We explain the integration of the techniques and demonstrate it on execution data from the Phoenix planner.<<ETX>>

[1]  Paul R. Cohen,et al.  Automating Path Analysis for Building Causal Models from Data , 1993, ICML.

[2]  Adele E. Howe,et al.  Test sequences as plans: an experiment in using an AI planner to generate system tests , 1995, Proceedings 1995 10th Knowledge-Based Software Engineering Conference.

[3]  P. Cohen,et al.  A Typology for Constructing Decisions , 1986 .

[4]  Paul R. Cohen,et al.  Failure Recovery: A Model and Experiments , 1991, AAAI.

[5]  Kevin T. Kelly,et al.  Discovering Causal Structure. , 1989 .

[6]  Adele E. Howe Analyzing Failure Recovery to Improve Planner Design , 1992, AAAI.

[7]  Adele E. Howe,et al.  Detecting Imperfect Patterns in Event Streams Using Local Search , 1995, AISTATS.

[8]  F. James Rohlf,et al.  Biometry: The Principles and Practice of Statistics in Biological Research , 1969 .

[9]  A. Howe Integrating Failure Recovery with Planner Debugging * , 1994 .

[10]  Adele E. Howe,et al.  Using Spreading Activation to Identify Relevant Help , 1984 .

[11]  Adele E. Howe,et al.  Methods for finding influences on program failure , 1994, Proceedings Sixth International Conference on Tools with Artificial Intelligence. TAI 94.

[12]  Paul R. Cohen,et al.  Predicting and explaining success and task duration in the Phoenix planner , 1992 .

[13]  Matthew L. Ginsberg,et al.  Universal Planning: An (Almost) Universally Bad Idea , 1989, AI Mag..

[14]  Li Li,et al.  System testing with an AI planner , 1995, Proceedings of Sixth International Symposium on Software Reliability Engineering. ISSRE'95.

[15]  Adele E. Howe Evaluating Planning Through Simulation: An Example Using Phoenix * , 1993 .

[16]  L. Darrell Whitley,et al.  Comparing Heuristic, Evolutionary and Local Search Approaches to Scheduling , 1996, AIPS.

[17]  P M Stanhope,et al.  Finding research funds with the GRANT system , 1987 .

[18]  Robert R. Sokal,et al.  The Principles and Practice of Statistics in Biological Research. , 1982 .

[19]  Raghavan Srinivasan,et al.  Comparison of Methods for Improving Search Efficiency in a Partial-Order Planner , 1995, IJCAI.

[20]  Larry D. Pyeatt,et al.  Constructing transition models of AI planner behavior , 1996, Proceedings of the 11th Knowledge-Based Software Engineering Conference.

[21]  A. Howe,et al.  New Methods for plan selection and refinement in a partial-order planner , 1995 .

[22]  Paul R. Cohen,et al.  Steps Toward Automating Decision Making , 1987 .

[23]  Ching Chun Li Path Analysis: A Primer , 1977 .

[24]  D. A. Kenny,et al.  Correlation and Causation. , 1982 .

[25]  Paul R. Cohen,et al.  Real-Time Problem Solving in The Phoenix Environment , 1990 .

[26]  David Chapman,et al.  Penguins Can Make Cake , 1989, AI Mag..

[27]  Paul R. Cohen,et al.  Understanding Planner Behavior , 1995, Artif. Intell..

[28]  Paul R. Cohen,et al.  Regression Can Build Predictive Causal Models , 1994 .

[29]  Adele E. Howe Accepting the inevitable: the role of failure recovery in the design of planners , 1993 .

[30]  Oren Etzioni,et al.  Intelligence without Robots: A Reply to Brooks , 1993, AI Mag..

[31]  Paul R. Cohen,et al.  Intelligent Real-time Problem Solvin: Issues and Examples , 1990 .

[32]  P. Suppes A Probabilistic Theory Of Causality , 1970 .

[33]  Rodney A. Brooks,et al.  Intelligence Without Reason , 1991, IJCAI.

[34]  Paul R. Cohen,et al.  Trial by Fire: Understanding the Design Requirements for Agents in Complex Environments , 1989, AI Mag..

[35]  A. E. Howe,et al.  A decision support system for wetland management on national wildlife refuges , 1994 .

[36]  Paul R. Cohen,et al.  Dominic: A Domain-Independent Program for Mechanical Engineering Design , 1986, Artif. Intell. Eng..

[37]  Adele E. Howe,et al.  An Information Gathering Agent for Querying Web Search Engines , 1996 .

[38]  D. A. Kenny,et al.  Correlation and Causation , 1937, Wilmott.

[39]  Judea Pearl,et al.  A Theory of Inferred Causation , 1991, KR.

[40]  Marcel Schoppers,et al.  In Defense of Reaction Plans as Caches , 1989, AI Mag..

[41]  Adele E. Howe,et al.  How evaluation guides AI research , 1988 .

[42]  Paul R. Cohen,et al.  Isolating dependencies on failure by analyzing execution traces , 1992 .

[43]  Paul R. Cohen,et al.  Toward AI research methodology: three case studies in evaluation , 1989, IEEE Trans. Syst. Man Cybern..