Toward Incremental Knowledge Correction for Agents in Complex Environments

In complex, dynamic environments, an agent's domain knowledge will rarely be complete and correct. Existing deliberate approaches to domain theory correction are signi cantly restricted in the environments where they can be used. These systems are typically not used in agent-based tasks and rely on declarative representations to support non-incremental learning. This research investigates the use of procedural knowledge to support deliberate incremental error correction in complex environments. We describe a series of domain properties that constrain the error correction process and that are violated by existing approaches. We then present a procedural representation for domain knowledge which is su ciently expressive, yet tractable. We develop a general framework for error detection and correction and then describe an error correction system, IMPROV, that uses our procedural representation to meet the constraints imposed by complex environments. Finally, we test the system in two sample domains and empirically demonstrate that it satis es many of the constraints faced by agents in complex and challenging environments.

[1]  Oren Etzioni,et al.  PRODIGY: an integrated architecture for planning and learning , 1991, SGAR.

[2]  Michael J. Pazzani,et al.  Revision of Production System Rule-Bases , 1994, ICML.

[3]  John E. Laird,et al.  The soar papers : research on integrated intelligence , 1993 .

[4]  Milind Tambe,et al.  Intelligent Agents for Interactive Simulation Environments , 1995, AI Mag..

[5]  John E. Laird,et al.  Integrating, Execution, Planning, and Learning in Soar for External Environments , 1990, AAAI.

[6]  Robert B. Doorenbos Matching 100, 000 Learned Rules , 1993, AAAI.

[7]  Yolanda Gil,et al.  A Domain-Independent Framework for Effective Experimentation in Planning , 1991, ML.

[8]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[9]  John E. Laird Recovery from Incorrect knowledge in Soar , 1988, AAAI.

[10]  Michael J. Pazzani,et al.  Integrated Learning with Incorrect and Incomplete Theories , 1988, ML.

[11]  L A Suprock,et al.  Changing the rules. , 2010, Geriatric nursing.

[12]  Haym Hirsh,et al.  Incremental batch learning , 1989, ICML 1989.

[13]  John H. Holland,et al.  Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems , 1995 .

[14]  Raymond J. Mooney,et al.  Changing the Rules: A Comprehensive Approach to Theory Refinement , 1990, AAAI.

[15]  Randolph M. Jones,et al.  A symbolic solution to intelligent real-time control , 1993, Robotics Auton. Syst..