Context-aware automated interpretation of elaborate natural language descriptions of location through learning from empirical data

ABSTRACT Natural language descriptions of location can be complex, involving many different elements and often describing location by reference to other objects. Descriptions may be vague, and their meaning often depends upon the context within which the description has been expressed. Many previous approaches use mathematical models, focus on prepositions, and have had limited success and application. We present an approach to the interpretation of geospatial natural language expressions that uses a knowledge base of expressions for which human interpretations (in the form of degree of match to one of 50 geometric configurations) are known. Our approach interprets new expressions by finding the most similar knowledge base expression and adopting its meaning. We determine expression similarity using four different methods: element match; linguistic collocation approaches (Cosine); wordnet semantic network distance and a new approach that incorporates the contextual aspects of the expression including scale, geometry type, axial structure, image-schema and liquid/solid. As well as preposition, relatum and locatum, we consider spatial adjectives, adverbs, verb and sub-parts of the relatum and locatum. The method that incorporates context was the most successful of the four tested, selecting the same geometric configuration as human respondents in 69% of cases.

[1]  Marcus Kracht,et al.  On the Semantics of Locatives , 2002 .

[2]  John A. Bateman,et al.  Language and Space: a two-level semantic approach based on principles of ontological engineering , 2010, Int. J. Speech Technol..

[3]  Woontack Woo,et al.  A Size-Based Qualitative Approach to the Representation of Spatial Granularity , 2007, IJCAI.

[4]  Antony Galton,et al.  The Mereotopology of Discrete Space , 1999, COSIT.

[5]  Ana Carolina Salgado,et al.  Towards a Context Ontology for Geospatial Data Integration , 2006, OTM Workshops.

[6]  Mark Johnson,et al.  The body in the mind: the bodily basis of meaning , 1988 .

[7]  結城 恵太,et al.  学生卒業論文 On the Semantics of English Prepositions , 2014 .

[8]  David W. Aha,et al.  Incremental, Instance-Based Learning of Independent and Graded Concept Descriptions , 1989, ML.

[9]  Eliseo Clementini,et al.  Qualitative Representation of Positional Information , 1997, Artif. Intell..

[10]  Philip David Smart,et al.  Spatial Natural Language Generation for Location Description in Photo Captions , 2015, COSIT.

[11]  Eliseo Clementini,et al.  Qualitative Distances , 1995, COSIT.

[12]  Kristin Stock,et al.  A Geometric Configuration Ontology to Support Spatial Querying , 2014 .

[13]  Marie-Francine Moens,et al.  Spatial role labeling: Towards extraction of spatial relations from natural language , 2011, TSLP.

[14]  Daniela Richter,et al.  Spatial interpretations of preposition "at" , 2012, GEOCROWD '12.

[15]  T. Odlin Women, Fire, and Dangerous Things: What Categories Reveal about the Mind , 1988 .

[16]  Stephan Winter,et al.  Harv esting large corpora for generating place graphs , 2015 .

[17]  Peter Simons,et al.  The Formalization of Husserl’s Theory of Wholes and Parts , 1992 .

[18]  Inderjeet Mani,et al.  SpatialML: Annotation Scheme, Corpora, and Tools , 2008, LREC.

[19]  Annette Herskovits,et al.  Language and spatial cognition , 1986 .

[20]  Elaine Marsh,et al.  Mental representations of spatial language , 1998, Int. J. Hum. Comput. Stud..

[21]  Boyan Brodaric,et al.  Geo‐Pragmatics for the Geospatial Semantic Web , 2007, Trans. GIS.

[22]  David M. Mark,et al.  CALIBRATING THE MEANINGS OF SPATIAL PREDICATES FROM NATURAL LANGUAGE: LINE-REGION RELATIONS* , 1994 .

[23]  G. Lakoff,et al.  Conceptual Metaphor in Everyday Language , 1980, Shaping Entrepreneurship Research.

[24]  Shihong Du,et al.  Multi-scale qualitative location: A direction-based model , 2013, Comput. Environ. Urban Syst..

[25]  T. Tenbrink,et al.  The Role of Conceptual and Linguistic Ontologies in Discourse , 2006 .

[26]  Jeremy Morley,et al.  Creating a corpus of geospatial language , 2012 .

[27]  David M. Mark,et al.  Experiential and Formal Models of Geographic Space , 1996 .

[28]  Sanja Fidler,et al.  The Role of Context for Object Detection and Semantic Segmentation in the Wild , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Naicong Li,et al.  Conceptual Framework for Modeling Dynamic Paths from Natural Language Expressions , 2009 .

[30]  Martha Palmer,et al.  Verb Semantics and Lexical Selection , 1994, ACL.

[31]  Douglas Herrmann,et al.  A Taxonomy of Part-Whole Relations , 1987, Cogn. Sci..

[32]  Joost Zwarts,et al.  Prepositional Aspect and the Algebra of Paths , 2005 .

[33]  M. Egenhofer,et al.  Topology of Prototypical Spatial Relations Between Lines and Regions in English and Spanish 1 , 1995 .

[34]  Daniel R. Montello,et al.  Scale and Multiple Psychologies of Space , 1993, COSIT.

[35]  Laure Vieu,et al.  Toward a formal representation of space in language: A commonsense reasoning approach , 2009 .

[36]  Leonard Talmy,et al.  Toward a cognitive semantics, Vol. 1: Concept structuring systems. , 2000 .

[37]  Bei Zhao,et al.  Scene Semantic Understanding Based on the Spatial Context Relations of Multiple Objects , 2017, Remote. Sens..

[38]  Mark Hall,et al.  The Role of Context in the Interpretation of Natural Language Location Descriptions , 2017, COSIT.

[39]  G. Lakoff Women, fire, and dangerous things : what categories reveal about the mind , 1989 .

[40]  Andrea Tyler,et al.  The semantics of English prepositions , 2003 .

[41]  Shihong Du,et al.  Multi‐Scale Qualitative Location: A Topology‐Based Model , 2014, Trans. GIS.

[42]  Kenny R. Coventry,et al.  Seeing, saying and acting: The psychological semantics of spatial prepositions , 2004 .

[43]  David M. Mark,et al.  Natural-Language Spatial Relations Between Linear and Areal Objects: The Topology and Metric of English-Language Terms , 1998, Int. J. Geogr. Inf. Sci..

[44]  Angela Schwering,et al.  Transitional Spaces: Between Indoor and Outdoor Spaces , 2013, COSIT.

[45]  Mark L. Johnson The body in the mind: the bodily basis of meaning , 1987 .

[46]  Roberto Casati,et al.  Parts and Places: The Structures of Spatial Representation , 1999 .

[47]  Shihong Du,et al.  Classifying natural-language spatial relation terms with random forest algorithm , 2017, Int. J. Geogr. Inf. Sci..

[48]  Eva Klien,et al.  The Role of Spatial Relations in Automating the Semantic Annotation of Geodata , 2005, COSIT.

[49]  Angela Schwering,et al.  The Influence of Scale, Context and Spatial Preposition in Linguistic Topology , 2006, Spatial Cognition.

[50]  Anthony G. Cohn,et al.  Describing Rigid Body Motions in a Qualitative Theory of Spatial Regions , 2000, AAAI/IAAI.

[51]  Angela Schwering,et al.  Evaluation of a Semantic Similarity Measure for Natural Language Spatial Relations , 2007, COSIT.

[52]  Robert Porzel Contextual Computing: Models and Applications , 2010 .

[53]  Walter Daelemans,et al.  Memory-Based Language Processing , 2009, Studies in natural language processing.

[54]  B. Landau,et al.  Whence and whither in spatial language and spatial cognition , 1993 .

[55]  Agnar Aamodt,et al.  Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches , 1994, AI Commun..

[56]  Andrew U. Frank,et al.  A Formalization of Metaphors and Image-Schemas in User Interfaces , 1991 .

[57]  I. Biederman,et al.  Scene perception: Detecting and judging objects undergoing relational violations , 1982, Cognitive Psychology.

[58]  S. Levinson Space in language and cognition: Explorations in cognitive diversity , 2003 .