Using Robustness to Learn to Order Semantic Properties in Referring Expression Generation

A sub-task of Natural Language Generation (NLG) is the generation of referring expressions (REG). REG algorithms aim to select attributes that unambiguously identify an entity with respect to a set of distractors. Previous work has defined a methodology to evaluate REG algorithms using real life examples with naturally occurring alterations in the properties of referring entities. It has been found that REG algorithms have key parameters tuned to exhibit a large degree of robustness. Using this insight, we present here experiments for learning the order of semantic properties used by a high performing REG algorithm. Presenting experiments on two types of entities (people and organizations) and using different versions of DBpedia (a freely available knowledge base containing information extracted from Wikipedia pages) we found that robustness of the tuned algorithm and its parameters do coincide but more work is needed to learn these parameters from data in a generalizable fashion.

[1]  Emiel Krahmer,et al.  Empirical Methods in Natural Language Generation: Data-oriented Methods and Empirical Evaluation , 2010, Empirical Methods in Natural Language Generation.

[2]  John D. Lafferty,et al.  Cranking: Combining Rankings Using Conditional Probability Models on Permutations , 2002, ICML.

[3]  Ielka van der Sluis,et al.  Generation of Referring Expressions: Assessing the Incremental Algorithm , 2012, Cogn. Sci..

[4]  Pablo Ariel Duboué,et al.  Evaluating Robustness of Referring Expression Generation Algorithms , 2015, 2015 Fourteenth Mexican International Conference on Artificial Intelligence (MICAI).

[5]  Jens Lehmann,et al.  DBpedia - A large-scale, multilingual knowledge base extracted from Wikipedia , 2015, Semantic Web.

[6]  Robert Dale,et al.  Computational Interpretations of the Gricean Maxims in the Generation of Referring Expressions , 1995, Cogn. Sci..

[7]  Emiel Krahmer,et al.  Is It That Difficult to Find a Good Preference Order for the Incremental Algorithm? , 2012, Cogn. Sci..

[8]  Kees van Deemter,et al.  From RAGS to RICHES: Exploiting the Potential of a Flexible Generation Architecture , 2001, ACL.

[9]  Ielka van der Sluis,et al.  Evaluating algorithms for the Generation of Referring Expressions using a balanced corpus , 2007, ENLG.

[10]  Pablo Ariel Duboué,et al.  On The Feasibility of Open Domain Referring Expression Generation Using Large Scale Folksonomies , 2012, HLT-NAACL.

[11]  Emiel Krahmer,et al.  Computational Generation of Referring Expressions: A Survey , 2012, CL.