An Action Representation Formalism to Interpret Natural Language Instructions

The focus of this paper is on an action representation formalism that encodes bothlinguistic andplanning knowledge about actions, and that supports the interpretation of complex Natural Language instructions and, in particular, of instructions containing Purpose Clauses. The representation uses linguistically motivated primitives, derived from Jackendoff's work on Conceptual Semantics, and is embedded in the description logic based system CLASSIC. I first motivate the characteristics of the formalism as needed to understand Natural Language instructions. I then describe the formalism itself, and I argue that the integration of a linguistically motivated lexical semantics formalism and of a description logic based system is beneficial to both. Finally, I show how the formalism is exploited by the algorithm that interprets Purpose Clauses. The output of the algorithm is used in theAnimation from NL project, that has as its goal the automatic creation of animated task simulations.

[1]  John A. Bateman.  Upper Modeling: organizing knowledge for natural language processing , 1990, INLG.

[2]  Enrico Franconi,et al.  A Computational Account for a Description Logic of Time and Action , 1994, KR.

[3]  Christopher W. Geib,et al.  The Intentional Planning System: ItPlanS , 1994, AIPS.

[4]  D. Litman,et al.  Subsumption and recognition of heterogeneous constraint networks , 1994, Proceedings of the Tenth Conference on Artificial Intelligence for Applications.

[5]  Martha E. Pollack,et al.  Inferring domain plans in question-answering , 1986 .

[6]  Norman I. Badler,et al.  Doing What You're Told: Following Task Instructions in Changing, but Hospitable Environments , 1992 .

[7]  Sandra Carberry,et al.  Plan Recognition in Natural Language Dialogue , 1990 .

[8]  Bonnie J. Dorr,et al.  Machine Translation: A View from the Lexicon , 1994, CL.

[9]  Barbara Di Eugenio.  Speaker’s Intentions and Beliefs in Negative Imperatives , 1993, Workshop On Intentionality And Structure In Discource Relations.

[10]  Roger C. Schank,et al.  SCRIPTS, PLANS, GOALS, AND UNDERSTANDING , 1988 .

[11]  James G. Schmolze,et al.  The KL-ONE family , 1992 .

[12]  Karen E. Lochbaum,et al.  Using collaborative plans to model the intentional structure of discourse , 1995 .

[13]  Clare R. Voss,et al.  Machine Translation of Spatial Expressions: Defining the Relation between an Interlingua and a Knowledge Representation System , 1993, AAAI.

[14]  Josh D. Tenenberg.  Inheritance in Automated Planning , 1989, KR.

[15]  Eugene Charniak,et al.  Motivation Analysis, Abductive Unification, and Nonmonotonic Equality , 1988, Artif. Intell..

[16]  Sergei Nirenburg,et al.  Syntax-Driven and Ontology-Driven Lexical Semantics , 1991, SIGLEX Workshop.

[17]  Libby Levison,et al.  Connecting planning and acting via object-specific reasoning , 1996 .

[18]  Christoph Weidenbach,et al.  Description Logics for Natural Language Processing , 1994 .

[19]  Sergei Nirenburg,et al.  The Correct Place of Lexical Semantics in Interlingual MT , 1994, COLING.

[20]  Premkumar T. Devanbu,et al.  Plan-Based Terminological Reasoning , 1991, KR.

[21]  William A. Woods,et al.  Understanding Subsumption and Taxonomy: A Framework for Progress , 1991, Principles of Semantic Networks.

[22]  Sandra A. Thompson,et al.  Grammar and written discourse: Initial vs. final purpose clauses in English , 1985 .

[23]  Timothy W. Bickmore,et al.  A basic agent , 1990, Comput. Intell..

[24]  Michael White,et al.  Conceptual Structures and CCG: Linking Theory and Incorporated Argument Adjuncts , 1992, COLING.

[25]  Norman I. Badler,et al.  Instructions, Intentions and Expectations , 1995, Artif. Intell..

[26]  Christopher W. Geib,et al.  SodaJack: An Architecture For Agents That Search For And Manipulate Objects , 1994 .

[27]  A. Goldman.  Theory of Human Action , 1970 .

[28]  John Yen,et al.  CLASP: Integrating Term Subsumption Systems and Production Systems , 1991, IEEE Trans. Knowl. Data Eng..

[29]  Breck Baldwin,et al.  Accommodating Context Change , 1992, ACL.

[30]  Johanna D. Moore.  Participating in explanatory dialogues , 1994 .

[31]  Cécile Paris,et al.  Expressing Procedural Relationships in Multilingual Instructions , 1994, INLG.

[33]  Terry Winograd,et al.  Understanding natural language , 1974 .

[34]  Manfred Stede,et al.  Mapping knowledge to language with LOOM , 1994 .

[35]  Cecile Tiberghien Balkanski,et al.  Actions, beliefs and intentions in multi-action utterances , 1993 .

[36]  Chris Mellish,et al.  Using Classification to Generate Text , 1992, ACL.

[37]  Richard Alterman,et al.  Interaction, Comprehension, and Instruction Usage , 1991 .

[38]  Norman I. Badler,et al.  Simulating humans: computer graphics animation and control , 1993 .

[39]  Peter F. Patel-Schneider,et al.  Living wiht Classic: When and How to Use a KL-ONE-Like Language , 1991, Principles of Semantic Networks.

[40]  Johanna D. Moore,et al.  DPOCL: A Principled Approach To Discourse Planning , 1994, INLG.

[41]  Keith Vander Linden,et al.  Rhetorical Relations in Instructional Text Generation , 1993, Workshop On Intentionality And Structure In Discource Relations.

[42]  Mark Steedman,et al.  Gapping as constituent coordination , 1990 .

[43]  Michael P. Wellman.  Formulation of tradeoffs in planning under uncertainty , 1988 .

[44]  James F. Allen.  Towards a General Theory of Action and Time , 1984, Artif. Intell..

[45]  Carsten Kindermann,et al.  Implementation of the BACK-System Version 4 , 1990 .

[46]  Marcel Joachim Schoppers,et al.  Representation and automatic synthesis of reaction plans , 1989 .

[47]  R. Wilensky.  Planning and Understanding: A Computational Approach to Human Reasoning , 1983 .

[48]  Barbara Di Eugenio,et al.  Understanding natural language instructions: a computational approach to purpose clauses , 1993 .

[49]  Bonnie Webber,et al.  Pragmatic overloading in Natural Language instructions , 1996 .

[50]  Beth Levin.  The contribution of linguistics , 1993 .

[51]  David J. Israel,et al.  Plans and resource‐bounded practical reasoning , 1988, Comput. Intell..

[52]  Barbara Di Eugenio,et al.  A Corpus Study of Negative Imperatives in Natural Language Instructions , 1996, COLING.

[53]  Yorick Wilks.  Review of Semantic structures by Ray Jackendoff. The MIT Press 1990. , 1992 .

[54]  Lynn Lambert,et al.  A Tripartite Plan-Based Model of Dialogue , 1991, ACL.

[55]  David Chapman,et al.  Vision, instruction, and action , 1990 .

[56]  Henry Kautz,et al.  A circumscriptive theory of plan recognition , 1990 .

[57]  Lenhart K. Schubert,et al.  Knowledge Representation in the TRAINS-93 Conversation System , 1996 .

[58]  Ronald J. Brachman,et al.  An Overview of the KL-ONE Knowledge Representation System , 1985, Cogn. Sci..

[59]  Robert M. MacGregor,et al.  A Deductive Pattern Matcher , 1988, AAAI.