Incremental Generation of Spatial Referring Expressions in Situated Dialog

This paper presents an approach to incrementally generating locative expressions. It addresses the issue of combinatorial explosion inherent in the construction of relational context models by: (a) contextually defining the set of objects in the context that may function as a landmark, and (b) sequencing the order in which spatial relations are considered using a cognitively motivated hierarchy of relations, and visual and discourse salience.

[1]  John D. Kelleher,et al.  Structural descriptions in human-assisted robot visual learning , 2006, HRI '06.

[2]  Deb Roy,et al.  Grounded Semantic Composition for Visual Scenes , 2011, J. Artif. Intell. Res..

[3]  Josef van Genabith,et al.  Visual Salience and Reference Resolution in Simulated 3-D Environments , 2004, Artificial Intelligence Review.

[4]  John D. Kelleher,et al.  Information Fusion for Visual Reference Resolution in Dynamic Situated Dialogue , 2006, PIT.

[5]  Kees van Deemter.  Generating Referring Expressions: Beyond the Incremental Algorithm , 2000 .

[6]  Annette Herskovits,et al.  Language and spatial cognition , 1986 .

[7]  Reinhard Moratz,et al.  Spatial Reference in Linguistic Human-Robot Interaction: Iterative, Empirically Supported Development of a Model of Projective Relations , 2006, Spatial Cogn. Comput..

[8]  Laura A. Carlson-Radvansky,et al.  The Influence of Reference Frame Selection on Spatial Template Construction , 1997 .

[9]  Emiel Krahmer,et al.  The influence of target size and distance on the production of speech and gesture in multimodal referring expressions , 2004, INTERSPEECH.

[10]  Kees van Deemter,et al.  Information sharing : reference and presupposition in language generation and interpretation , 2002 .

[11]  Helmut Horacek,et al.  An Algorithm for Generating Referential Descriptions with Flexible Interfaces , 1997, ACL.

[12]  B. Tversky,et al.  Internal and external spatial frameworks for representing described scenes , 1992 .

[13]  Josef van Genabith,et al.  A False Colouring Real Time Visual Saliency Algorithm for Reference Resolution in Simulated 3-D Environments , 2003 .

[14]  Robert Dale,et al.  Generating Referring Expressions Involving Relations , 1991, EACL.

[15]  Klaus-Peter Gapp.  Angle, Distance, Shape, and their Relationship to Projective Relations , 1995 .

[16]  P. N. Johnson-Laird.  Language and spatial cognition: an interdisciplinary study of prepositions in English: by Annette Herskovits, Cambridge: Cambridge University Press, 1986 , 1989 .

[17]  Sebastian Varges,et al.  Overgenerating Referring Expressions Involving Relations and Booleans , 2004, INLG.

[18]  Geoffrey Edwards,et al.  Toward the simulation of spatial mental images using the Voronoi¨ model , 1998 .

[19]  Philip R. Cohen,et al.  Referring as a Collaborative Process , 2003 .

[20]  Robert Dale,et al.  Computational Interpretations of the Gricean Maxims in the Generation of Referring Expressions , 1995, Cogn. Sci..

[21]  G. Logan.  Spatial attention and the apprehension of spatial relations. , 1994, Journal of experimental psychology. Human perception and performance.

[22]  Leonard Talmy,et al.  How Language Structures Space , 1983 .

[23]  David D. McDonald,et al.  Salience: The Key to the Selection Problem in Natural Language Generation , 1982, ACL.

[24]  Patrick Oliver,et al.  Representation and Processing of Spatial Expressions , 1998 .

[25]  John D. Kelleher,et al.  Proximity in Context: An Empirically Grounded Computational Model of Proximity for Processing Topological Spatial Expressions , 2006, ACL.

[26]  S. Garrod,et al.  In and on: investigating the functional geometry of spatial prepositions , 1999, Cognition.

[27]  D. E. Irwin,et al.  Reference Frame Activation during Spatial Term Assignment , 1994 .

[28]  Claire Gardent,et al.  Generating Minimal Definite Descriptions , 2002, ACL.

[29]  Emiel Krahmer,et al.  Efficient context-sensitive generation of referring expressions , 2002 .

[30]  Robbert-Jan Beun,et al.  Object reference in a shared domain of conversation , 1998 .

[31]  G. Logan.  Linguistic and Conceptual Control of Visual Spatial Attention , 1995, Cognitive Psychology.

[32]  A Treisman,et al.  Feature analysis in early vision: evidence from search asymmetries. , 1988, Psychological review.

[33]  Eva Hajičová,et al.  Issues of Sentence Structure and Discourse Patterns. , 1993 .