Report on the Second Second Challenge on Generating Instructions in Virtual Environments (GIVE-2.5)

GIVE-2.5 evaluates eight natural language generation (NLG) systems that guide human users through solving a task in a virtual environment. The data is collected via the Internet, and to date, 536 interactions of subjects with one of the NLG systems have been recorded. The systems are compared using both task performance measures and subjective ratings by human users.

[1]  Luciana Benotti,et al.  CL system: Giving instructions by corpus based selection , 2011, ENLG.

[2]  Kees van Deemter,et al.  Direction giving: an attempt to increase user engagement , 2011, ENLG.

[3]  Luciana Benotti,et al.  The GIVE-2.5 C Generation System , 2011, ENLG.

[4]  Alexander Koller,et al.  The Potsdam NLG systems at the GIVE-2.5 Challenge , 2011, ENLG.

[5]  Johanna D. Moore,et al.  The First Challenge on Generating Instructions in Virtual Environments , 2010, Empirical Methods in Natural Language Generation.

[6]  Alexander Koller,et al.  The GIVE-2 Corpus of Giving Instructions in Virtual Environments , 2010, LREC.

[7]  Alexandre Denis.  The Loria Instruction Generation System L in GIVE 2.5 , 2011, ENLG.

[8]  David Traum,et al.  Computational Models of Grounding in Collaborative Systems , 1999 .

[9]  Oliver Lemon,et al.  The GRUVE Challenge: Generating Routes under Uncertainty in Virtual Environments , 2011, ENLG.

[10]  Nina Dethlefs.  The Bremen System for the GIVE-2.5 Challenge , 2011, ENLG.

[11]  Johanna D. Moore,et al.  The Software Architecture for the First Challenge on Generating Instructions in Virtual Environments , 2009, EACL.

[12]  Johanna D. Moore,et al.  Report on the Second NLG Challenge on Generating Instructions in Virtual Environments (GIVE-2) , 2010, INLG.

[13]  Mariët Theune,et al.  The Thumbs Up! Twente system for GIVE 2.5 , 2011, ENLG.

[14]  Laurent Romary,et al.  Generating Referring Expressions in Multimodal Contexts , 2000 .