Team word-guessing games where one player, the clue-giver, gives clues attempting to elicit a target-word from another player, the receiver, are a popular form of entertainment and also used for educational purposes. Creating an engaging computational agent capable of emulating a talented human clue-giver in a timed word-guessing game depends on the ability to provide effective clues (clues able to elicit a correct guess from a human receiver). There are many available web resources and databases that can be mined for the raw material for clues for target-words; however, a large number of those clues are unlikely to be able to elicit a correct guess from a human guesser. In this paper, we propose a method for automatically filtering a clue corpus for effective clues for an arbitrary target-word from a larger set of potential clues, using machine learning on a set of features of the clues, including point-wise mutual information between a clue’s constituent words and a clue’s target-word. The results of the experiments significantly improve the average clue quality over previous approaches, and bring quality rates in-line with measures of human clue quality derived from a corpus of human-human interactions. The paper also introduces the data used to develop this method; audio recordings of people making guesses after having heard the clues being spoken by a synthesized voice.
[1]
Minako Sawaki,et al.
“Who is this” quiz dialogue system and users' evaluation
,
2008,
2008 IEEE Spoken Language Technology Workshop.
[2]
David DeVault,et al.
A Multimodal Corpus of Rapid Dialogue Games
,
2014,
LREC.
[3]
Eli Pincus,et al.
Towards a Multimodal Taxonomy of Dialogue Moves for Word-Guessing Games
,
2014
.
[4]
Susan T. Dumais,et al.
Inductive learning algorithms and representations for text categorization
,
1998,
CIKM '98.
[5]
Ian H. Witten,et al.
The WEKA data mining software: an update
,
2009,
SKDD.
[6]
Ryuichiro Higashinaka,et al.
Learning to Rank Definitions to Generate Quizzes for Interactive Information Presentation
,
2007,
ACL.
[7]
David DeVault,et al.
Mr. Clue - A Virtual Agent that can Play Word-Guessing Games
,
2014
.
[8]
George A. Miller,et al.
WordNet: A Lexical Database for English
,
1995,
HLT.
[9]
Akshay Java,et al.
The ICWSM 2009 Spinn3r Dataset
,
2009
.