Developing a Meta-Level Problem Solver for Integrated Learners

A learning system may need several methods that follow different learning strategies in order to learn how to perform complex tasks. For example, a learning method may be used to generalize from user demonstrations, another to learn by practice and exploration, and another to test hypotheses with experiments. In such an integrated learning system, there is a need for systematically coordinating the activities of the participating learning agents especially to ensure that the system creates appropriate procedural knowledge. In this paper, we describe an approach for developing a meta-level problem solver that coordinates different agents in an integrated learning system based on their capabilities and status of learning. The system is called Maven. Maven is cast on a BDI-style framework with explicit representation of learning goals, a set of plans for achieving learning goals, and high-level learning strategies that prioritize learning goals. By supporting both top-down and bottom-up control strategies, Maven supports flexible interaction among learners. The status of desired learning goals and goal achievement history enables assessment of learning progress over time. Maven is being used for coordinating learning agents to acquire complex process knowledge.

[1]  E. Tulving Elements of episodic memory , 1983 .

[2]  Stuart J. Russell,et al.  Principles of Metareasoning , 1989, Artif. Intell..

[3]  Henry Lieberman,et al.  Watch what I do: programming by demonstration , 1993 .

[4]  David B. Leake,et al.  Goal-driven learning , 1995 .

[5]  Thomas G. Dietterich Ensemble Methods in Machine Learning , 2000, Multiple Classifier Systems.

[6]  Michael Wooldridge,et al.  Principles of intention reconsideration , 2001, AGENTS '01.

[7]  Manuela M. Veloso,et al.  DISTILL: Learning Domain-Specific Planners by Example , 2003, ICML.

[8]  Yolanda Gil,et al.  Proactive Acquisition from Tutoring and Learning Principles , 2003 .

[9]  Karen L. Myers,et al.  The SPARK agent framework , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[10]  Hector Muñoz-Avila,et al.  Applications of SHOP and SHOP2 , 2005, IEEE Intelligent Systems.

[11]  David C. Noelle Learning from Advice , 2006 .

[12]  T. Oates,et al.  Workflow Inference : What to Do with One Example and No Semantics , 2007 .

[13]  Talib S. Hussain,et al.  An Architecture and Language for the Integrated Learning of Demonstrations , 2007 .

[14]  Nathanael Chambers,et al.  PLOW: A Collaborative Task Learning Agent , 2007, AAAI.

[15]  Michael T. Cox Metareasoning: A manifesto , 2007 .

[16]  Yolanda Gil,et al.  Incorporating tutoring principles into interactive knowledge acquisition , 2007, Int. J. Hum. Comput. Stud..

[17]  P. Cohen,et al.  Designing Experiments to Test Planning Knowledge about Plan-step Order Constraints , 2007 .

[18]  Tim Oates,et al.  A Review of Recent Research in Metareasoning and Metalearning , 2007, AI Mag..

[19]  Yolanda Gil,et al.  Interactive Knowledge Acquisition Tools: A Tutoring Perspective , 2002 .