A Hearer-Oriented Evaluation of Referring Expression Generation

This paper discusses the evaluation of a Generation of Referring Expressions algorithm that takes structural ambiguity into account. We describe an ongoing study with human readers.

[1]  Kees van Deemter,et al.  Generation of Referring Expressions: Managing Structural Ambiguities , 2008, COLING.

[2]  A. Kilgarriff,et al.  Thesauruses for natural language processing , 2003, International Conference on Natural Language Processing and Knowledge Engineering, 2003. Proceedings. 2003.

[3]  Emiel Krahmer,et al.  Efficient context-sensitive generation of referring expressions , 2002 .

[4]  Albert Gatt,et al.  Attribute Selection for Referring Expression Generation: New Algorithms and Evaluation Methods , 2008, INLG.

[5]  Robert Dale,et al.  Towards the Evaluation of Referring Expression Generation , 2006, ALTA.

[6]  Adam Kilgarriff,et al.  Shared-Task Evaluations in HLT: Lessons for NLG , 2006, INLG.

[7]  Kees van Deemter.  Towards a Probabilistic Version of Bidirectional OT Syntax and Semantics , 2004, J. Semant..

[8]  Amanda Stent,et al.  Automatic Evaluation of Referring Expression Generation Using Corpora ∗ , 2005 .

[9]  Chris Mellish,et al.  Evaluation in the context of natural language generation , 1998, Comput. Speech Lang..

[10]  Anja Belz,et al.  Comparing Automatic and Human Evaluation of NLG Systems , 2006, EACL.

[11]  Advaith Siddharthan,et al.  Generating Referring Expressions in Open Domains , 2004, ACL.

[12]  Judith Masthoff,et al.  Overspecified Reference in Hierarchical Domains: Measuring the Benefits for Readers , 2006, INLG.

[13]  Francis Chantree,et al.  Identifying Nocuous Ambiguities in Natural Language Requirements , 2006, 14th IEEE International Requirements Engineering Conference (RE'06).

[14]  Ross Wilkinson,et al.  Evaluations of NLG Systems: Common Corpus and Tasks or Common Dimensions and Metrics? , 2006, INLG.

[15]  Albert Gatt,et al.  Generating coherent references to multiple entities , 2007 .

[16]  Ielka van der Sluis,et al.  Building a Semantically Transparent Corpus for the Generation of Referring Expressions. , 2006, INLG.

[17]  Matthew Stone,et al.  Textual Economy Through Close Coupling of Syntax and Semantics , 1998, INLG.