A Reasoning Module for Long-lived Cognitive Agents

In this thesis we study a reasoning module for agents that have cognitive abilities, such as memory, perception, action, and are expected to function autonomously for long periods of time. The module provides the ability to reason about action and change using the language of the situation calculus and variants of the basic action theories. The main focus of this thesis is on the logical problem of progressing an action theory. First, we investigate the conjecture by Lin and Reiter that a practical first-order definition of progression is not appropriate for the general case. We show that Lin and Reiter were indeed correct in their intuitions by providing a proof for the conjecture, thus resolving the open question about the first-order definability of progression and justifying the need for a second-order definition. Then we proceed to identify three cases where it is possible to obtain a first-order progression with the desired properties: (i) we extend earlier work by Lin and Reiter and present a case where we restrict our attention to a practical class of queries that may only quantify over situations in a limited way; (ii) we revisit the local-effect assumption of Lin and Levesque that requires that the effects of an action are fixed by the arguments of the action and show that in this case a first-order progression is suitable; (iii) we investigate a way that the local-effect assumption can be relaxed and show that when the initial knowledge base is a database of possible closures and the effects of the actions are range-restricted then a first-order progression is also suitable under a just-in-time assumption. Finally, we examine a special case of the action theories with range-restricted effects and present an algorithm for computing a finite progression. We prove the correctness and the complexity of the algorithm, and show its application in a simple example that is inspired by video games.

[1]  N. Malcolm On Knowledge and Belief , 1954 .

[2]  J. Davenport Editor , 1960 .

[3]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[4]  Herbert B. Enderton,et al.  A mathematical introduction to logic , 1972 .

[5]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[6]  Elliott Mendelson,et al.  Introduction to Mathematical Logic , 1979 .

[7]  John McCarthy,et al.  Circumscription - A Form of Non-Monotonic Reasoning , 1980, Artif. Intell..

[8]  Raymond Reiter,et al.  A Logic for Default Reasoning , 1987, Artif. Intell..

[9]  John McCarthy,et al.  SOME PHILOSOPHICAL PROBLEMS FROM THE STANDPOINT OF ARTI CIAL INTELLIGENCE , 1987 .

[10]  Editors , 1986, Brain Research Bulletin.

[11]  E. Pednault Toward a mathematical theory of plan synthesis , 1987 .

[12]  Marcel Schoppers,et al.  Universal Plans for Reactive Robots in Unpredictable Environments , 1987, IJCAI.

[13]  R. Lathe Phd by thesis , 1988, Nature.

[14]  Raymond Reiter,et al.  The Frame Problem in the Situation Calculus: A Simple Solution (Sometimes) and a Completeness Result for Goal Regression , 1991, Artificial and Mathematical Theory of Computation.

[15]  Norman Y. Foo,et al.  On the expressibility of propositions , 1992 .

[16]  Raymond Reiter,et al.  Proving Properties of States in the Situation Calculus , 1993, Artif. Intell..

[17]  Yoav Shoham Agent-Oriented Programming , 1993, Artif. Intell..

[18]  Michael Gelfond,et al.  Representing Action and Change by Logic Programs , 1993, J. Log. Program..

[19]  Hector J. Levesque,et al.  The Frame Problem and Knowledge-Producing Actions , 1993, AAAI.

[20]  Daniel Marcu,et al.  A Logical Approach to High-Level Robot Programming A Progress Report* , 1994 .

[21]  S. Rebecca Thomas,et al.  The PLACA Agent Programming Language , 1995, ECAI Workshop on Agent Theories, Architectures, and Languages.

[22]  Erik Sandewall Features and fluents : representation of knowledge about dynamical systems , 1994 .

[23]  Krzysztof R. Apt,et al.  On the occur-check-free PROLOG programs , 1994, TOPL.

[24]  Serge Abiteboul,et al.  Foundations of Databases: The Logical Level , 1995 .

[25]  E. Sandewall Features and fluents (vol. 1): the representation of knowledge about dynamical systems , 1995 .

[26]  Hector J. Levesque,et al.  What Is Planning in the Presence of Sensing? , 1996, AAAI/IAAI, Vol. 2.

[27]  A. S. Roa,et al.  AgentSpeak(L): BDI agents speak out in a logical computable language , 1996 .

[28]  Hector J. Levesque,et al.  GOLOG: A Logic Programming Language for Dynamic Domains , 1997, J. Log. Program..

[29]  Fangzhen Lin,et al.  How to Progress a Database , 1997, Artif. Intell..

[30]  Hector J. Levesque,et al.  Reasoning about Concurrent Execution Prioritized Interrupts, and Exogenous Actions in the Situation Calculus , 1997, IJCAI.

[31]  Jelle Gerbrandy,et al.  Dynamic epistemic logic , 1998 .

[32]  Michael Thielscher,et al.  From Situation Calculus to Fluent Calculus: State Update Axioms as a Solution to the Inferential Frame Problem , 1999, Artif. Intell..

[33]  Murray Shanahan,et al.  The Event Calculus Explained , 1999, Artificial Intelligence Today.

[34]  Hector J. Levesque,et al.  An Incremental Interpreter for High-Level Programs with Sensing , 1999 .

[35]  Raymond Reiter,et al.  Some contributions to the metatheory of the situation calculus , 1999, JACM.

[36]  Hector J. Levesque,et al.  Projection Using Regression and Sensors , 1999, IJCAI.

[37]  Maria del Pilar Pozos Parra,et al.  A Simple and Tractable Extension of Situation Calculus to Epistemic Logic , 2000, ISMIS.

[38]  Michael Thielscher,et al.  Representing the Knowledge of a Robot , 2000, KR.

[39]  Raymond Reiter,et al.  Knowledge in Action: Logical Foundations for Specifying and Implementing Dynamical Systems , 2001 .

[40]  Tran Cao Son,et al.  Formalizing sensing actions A transition function based approach , 2001, Artif. Intell..

[41]  Michael Thielscher,et al.  The Qualification Problem: A solution to the problem of anomalous models , 2001, Artif. Intell..

[42]  John G. Gibbons Knowledge in Action , 2001 .

[43]  Hector J. Levesque,et al.  Incremental execution of guarded theories , 2001, ACM Trans. Comput. Log..

[44]  Fahiem Bacchus,et al.  A Knowledge-Based Approach to Planning with Incomplete Information and Sensing , 2002, AIPS.

[45]  Alfredo Gabaldon,et al.  Non-Markovian control in the situation calculus , 2002, Artif. Intell..

[46]  Hector J. Levesque,et al.  Knowledge, action, and the frame problem , 2003, Artif. Intell..

[47]  Koen V. Hindriks,et al.  Agent Programming in 3APL , 1999, Autonomous Agents and Multi-Agent Systems.

[48]  Fahiem Bacchus,et al.  Extending the Knowledge-Based Approach to Planning with Incomplete Information and Sensing , 2004, ICAPS.

[49]  Stavros Vassos,et al.  The Wumpus World in INDIGOLOG : A Preliminary Report , 2005 .

[50]  Eyal Amir,et al.  First-Order Logical Filtering , 2005, IJCAI.

[51]  Hector J. Levesque,et al.  Tractable Reasoning with Incomplete First-Order Knowledge in Dynamic Systems with Context-Dependent Actions , 2005, IJCAI.

[52]  Michael Thielscher,et al.  Under Consideration for Publication in Theory and Practice of Logic Programming Flux: a Logic Programming Method for Reasoning Agents , 2003 .

[53]  Chitta Baral,et al.  Logic Programming and Reasoning about Actions , 2005, Handbook of Temporal Reasoning in Artificial Intelligence.

[54]  Hector J. Levesque,et al.  Planning with Loops , 2005, IJCAI.

[55]  Sebastian Sardina,et al.  Deliberation in agent programming languages , 2005 .

[56]  Tonya Lewis,et al.  Knowledge in Action , 1977 .

[57]  Dan Suciu,et al.  Journal of the ACM , 2006 .

[58]  Francesco Savelli,et al.  Existential assertions and quantum levels on the tree of the situation calculus , 2006, Artif. Intell..

[59]  Stefan Edelkamp,et al.  Automated Planning: Theory and Practice , 2007, Künstliche Intell..

[60]  Andreas Herzig,et al.  Optimal Regression for Reasoning about Knowledge and Actions , 2007, AAAI.

[61]  Adrian R. Pearce,et al.  Property Persistence in the Situation Calculus , 2007, IJCAI.

[62]  Hector J. Levesque,et al.  Progression of Situation Calculus Action Theories with Incomplete Information , 2007, IJCAI.

[63]  Hector J. Levesque,et al.  On the Progression of Situation Calculus Basic Action Theories: Resolving a 10-year-old Conjecture , 2008, AAAI.

[64]  Gerhard Lakemeyer,et al.  Point-based value iteration: an anytime algorithm for POMDPs , 2003, IJCAI 2003.

[65]  Michael Gelfond,et al.  Classical negation in logic programs and disjunctive databases , 1991, New Generation Computing.

[66]  Gerhard Lakemeyer,et al.  Proceedings of the Ninth International Symposium on Logical Formalizations of Commonsense Reasoning , 2009 .

[67]  Steffen Hölldobler,et al.  A new deductive approach to planning , 1989, New Generation Computing.

[68]  Marek J. Sergot,et al.  A logic-based calculus of events , 1989, New Generation Computing.