The Recognition and Interpretation of Motion in Language

In this paper, we develop a framework for interpreting linguistic descriptions of places and locations as well as objects in motion as found in natural language texts. We present an overview of existing qualitative spatiotemporal models in order to discuss a more dynamic model of motion called Dynamic Interval Temporal Logic (DITL). The resulting static and dynamic descriptions are represented in a spatiotemporal markup language called STML. The STML output then enables a grounding within a metric representation such as Google Earth, through an automatic conversion to KML. Consistent with the STML output, DITL provides a semantics for STML for subsequent reasoning about the text.

[1]  O. Stock.  Spatial and Temporal Reasoning , 1899 .

[2]  Ray Jackendoff.  Semantics and Cognition , 1983 .

[3]  Leonard Talmy,et al.  How Language Structures Space , 1983 .

[4]  H. Pick,et al.  Spatial orientation : theory, research, and application , 1984 .

[5]  James F. Allen.  Towards a General Theory of Action and Time , 1984, Artif. Intell..

[6]  Ben C. Moszkowski,et al.  Executing temporal logic programs , 1986, Seminar on Concurrency.

[7]  Annette Herskovits,et al.  Language and spatial cognition , 1986 .

[8]  Jeroen Groenendijk,et al.  Dynamic predicate logic , 1991 .

[9]  MAX J. EGENHOFER,et al.  Point Set Topological Relations , 1991, Int. J. Geogr. Inf. Sci..

[10]  M. Bowerman,et al.  Learning to express motion events in English and Korean: The influence of language-specific lexicalization patterns , 1991, Cognition.

[11]  Anthony G. Cohn,et al.  A Spatial Logic based on Regions and Connection , 1992, KR.

[12]  Christian Freksa,et al.  Using Orientation Information for Qualitative Spatial Reasoning , 1992, Spatio-Temporal Reasoning.

[13]  Antony Galton,et al.  Towards an Integrated Logic of Space, Time and Motion , 1993, IJCAI.

[14]  Laure Vieu,et al.  Toward a Geometry of Common Sense: A Semantics and a Complete Axiomatization of Mereotopology , 1995, IJCAI.

[15]  Nicholas Asher,et al.  A Typology and Discourse Semantics for Motion Verbs and Spatial PPs in French , 1995, J. Semant..

[16]  Zohar Manna,et al.  Temporal verification of reactive systems - safety , 1995 .

[17]  David M. Mark,et al.  Modelling Conceptual Neighbourhoods of Toplogical Line-Region Relations , 1995, Int. J. Geogr. Inf. Sci..

[18]  Zohar Manna,et al.  Temporal Verification of Reactive Systems , 1995, Springer New York.

[19]  Ralph Grishman,et al.  Message Understanding Conference- 6: A Brief History , 1996, COLING.

[20]  Antony Galton,et al.  Space, Time, and Movement , 1997 .

[21]  Richard M. Schwartz,et al.  Nymble: a High-Performance Learning Name-finder , 1997, ANLP.

[22]  Philippe Muller,et al.  A Qualitative Theory of Motion Based on Spatio-Temporal Primitives , 1998, KR.

[23]  Frank Wolter,et al.  Spatio-temporal representation and reasoning based on RCC-8 , 2000, International Conference on Principles of Knowledge Representation and Reasoning.

[24]  Inderjeet Mani,et al.  Robust Temporal Processing of News , 2000, ACL.

[25]  A. Galton.  Qualitative Spatial Change , 2001 .

[26]  Anthony G. Cohn,et al.  Qualitative Spatial Representation and Reasoning: An Overview , 2001, Fundam. Informaticae.

[27]  R. Naumann,et al.  Aspects of changes: a dynamic event semantics , 2001, J. Semant..

[28]  Jerzy Tiuryn,et al.  Dynamic logic , 2001, SIGA.

[29]  Inderjeet Mani,et al.  Guidelines for Annotating Temporal Information , 2001, HLT.

[30]  Yde Venema,et al.  Dynamic Logic by David Harel, Dexter Kozen and Jerzy Tiuryn. The MIT Press, Cambridge, Massachusetts. Hardback: ISBN 0–262–08289–6, $50, xv + 459 pages , 2002, Theory and Practice of Logic Programming.

[31]  Dov M. Gabbay,et al.  Handbook of Philosophical Logic , 2002 .

[32]  James Pustejovsky,et al.  TimeML: Robust Specification of Event and Temporal Expressions in Text , 2003, New Directions in Question Answering.

[33]  D. Mitra.  Modeling and Reasoning with Star Calculus: An Extended Abstract , 2003 .

[34]  Bhuvana Narasimhan,et al.  Motion events and the lexicon: a case study of Hindi , 2003 .

[35]  Satoshi Sekine,et al.  Definition, Dictionaries and Tagger for Extended Named Entity Hierarchy , 2004, LREC.

[36]  Doug Downey,et al.  Unsupervised named-entity extraction from the Web: An experimental study , 2005, Artif. Intell..

[37]  Marc Verhagen,et al.  Temporal Closure in an Annotation Environment , 2005, Lang. Resour. Evaluation.

[38]  James Pustejovsky,et al.  Automating Temporal Annotation with TARSQI , 2005, ACL.

[39]  R. Declerck,et al.  Spatial and temporal boundedness in English motion events , 2005 .

[40]  James Pustejovsky,et al.  Temporal and Event Information in Natural Language Text , 2005, Lang. Resour. Evaluation.

[41]  James Pustejovsky,et al.  Annotating and Recognizing Event Modality in Text , 2006, FLAIRS.

[42]  James Pustejovsky,et al.  Towards a Generative Lexical Resource: The Brandeis Semantic Ontology , 2006, LREC.

[43]  James Pustejovsky,et al.  SlinkET: A Partial Modal Parser for Events , 2006, LREC.

[44]  James Pustejovsky,et al.  Machine Learning of Temporal Relations , 2006, ACL.

[45]  Kathleen Stewart,et al.  Modeling Moving Geospatial Objects from an Event-based Perspective , 2007, Trans. GIS.

[46]  James Pustejovsky,et al.  TimeBank evolution as a community resource for TimeML parsing , 2007, Lang. Resour. Evaluation.

[47]  Max J. Egenhofer,et al.  The 9+-Intersection for Topological Relations between a Directed Line Segment and a Region , 2007, BMI.

[48]  Anthony G. Cohn,et al.  Qualitative Spatial Representation and Reasoning , 2008, Handbook of Knowledge Representation.

[49]  Inderjeet Mani,et al.  SpatialML: Annotation Scheme, Corpora, and Tools , 2008, LREC.

[50]  James Pustejovsky,et al.  Temporal Processing with the TARSQI Toolkit , 2008, COLING.

[51]  James Pustejovsky,et al.  Integrating Motion Predicate Classes with Spatial and Temporal Annotations , 2008, COLING.

[52]  Stephan Merz,et al.  Temporal Logic and State Systems , 2008, Texts in Theoretical Computer Science. An EATCS Series.

[53]  Annette Herskovits.  Language and Spatial Cognition: An Interdisciplinary Study of the Prepositions in English , 2009 .

[54]  Beth Levin,et al.  Reflections on Manner/Result Complementarity* , 2010 .

[55]  Thora Tenbrink,et al.  A linguistic ontology of space for natural language processing , 2010, Artif. Intell..

[56]  James Pustejovsky,et al.  The Qualitative Spatial Dynamics of Motion in Language , 2011, Spatial Cogn. Comput..