A Computational Model of the Referential Semantics of Projective Prepositions

In this paper we present a framework for interpreting locative expressions containing the prepositions in front of and behind. These prepositions have different semantics in the viewer-centred and intrinsic frames of reference (Vandeloise, 1991). We define a model of their semantics in each frame of reference. The basis of these models is a novel parameterized continuum function that creates a 3-D spatial template. In the intrinsic frame of reference the origin used by the continuum function is assumed to be known a priori and object occlusion does not impact on the applicability rating of a point in the spatial template. In the viewer-centred frame the location of the spatial template’s origin is dependent on the user’s perception of the landmark at the time of the utterance and object occlusion is integrated into the model. Where there is an ambiguity with respect to the intended frame of reference, we define an algorithm for merging the spatial templates from the competing frames of reference, based on psycholinguistic observations in (Carlson-Radvansky, 1997).

[1]  Willem J. M. Levelt,et al.  Perspective taking and ellipsis in spatial descriptions , 1996 .

[2]  B. Landau,et al.  Spatial language and spatial cognition , 2013 .

[3]  Patrick Olivier,et al.  Quantitative perceptual representation of prepositional semantics , 2004, Artificial Intelligence Review.

[4]  Thomas Rist,et al.  On the Simultaneous Interpretation of Real World Image Sequences and their Natural Language Description: The System Soccer , 1988, ECAI.

[5]  山田 篤.  Studies on spatial description understanding based on geometric constraints satisfaction , 1993 .

[6]  D. E. Irwin,et al.  Reference Frame Activation during Spatial Term Assignment , 1994 .

[7]  R. Langacker.  Foundations of cognitive grammar , 1983 .

[8]  Phillip J. Holcomb,et al.  “Could you hand me those keys on the right?” Disentangling spatial reference frames using different methodologies , 1999, Spatial Cogn. Comput..

[9]  Annette Herskovits,et al.  Language and spatial cognition , 1986 .

[10]  P. N. Johnson-Laird.  Language and spatial cognition: an interdisciplinary study of prepositions in English: by Annette Herskovits, Cambridge: Cambridge University Press, 1986 , 1989 .

[11]  Claude Vandeloise,et al.  Spatial Prepositions: A Case Study from French , 1991 .

[12]  Klaus-Peter Gapp.  Angle, Distance, Shape, and their Relationship to Projective Relations , 1995 .

[13]  H. H. Clark.  SPACE, TIME, SEMANTICS, AND THE CHILD , 1973 .

[14]  Gerhard Sagerer,et al.  A three-dimensional spatial model for the interpretation of image data , 1998, IJCAI 1995.

[15]  Gordon D. Logan,et al.  A computational analysis of the apprehension of spatial relations , 1996 .

[16]  John D. Kelleher.  A perceptually based computational framework for the interpretation of spatial language , 2003 .

[17]  Amitabha Mukerjee,et al.  Conceptual description of visual scenes from linguistic models , 2000, Image Vis. Comput..

[18]  Terry Winograd,et al.  A procedural model of language understanding , 1986 .

[19]  Josef van Genabith,et al.  A False Colouring Real Time Visual Saliency Algorithm for Reference Resolution in Simulated 3-D Environments , 2003 .

[20]  Laura A. Carlson-Radvansky,et al.  The Influence of Reference Frame Selection on Spatial Template Construction , 1997 .

[21]  S. Levinson.  Frames of reference and Molyneux's question: Cross-linguistic evidence , 1996 .

[22]  Barbara Landau,et al.  The representation of space and spatial language: challenges for cognitive science , 1998 .

[23]  David E. Irwin,et al.  Frames of reference in vision and language: Where is above? , 1993, Cognition.

[24]  Yoad Winter,et al.  Vector Space Semantics: A Model-Theoretic Analysis of Locative Prepositions , 2000, J. Log. Lang. Inf..

[25]  Daniel Thalmann,et al.  Navigation for digital actors based on synthetic vision, memory, and learning , 1995, Comput. Graph..