Use of WordNet Hypernyms for Answering What-Is Questions

We present a preliminary analysis of the use of WordNet hypernyms for answering “What-is” questions. We analyse the approximately 130 definitional questions in the TREC10 corpus with respect to our technique of Virtual Annotation (VA), which has previously been shown to be effective on the TREC9 definitional question set and other questions. We discover that VA is effective on a subset of the TREC10 definitional questions, but that some of these questions seem to need a user model to generate correct answers, or at least answers that agree with the NIST judges. Furthermore, there remains a large enough subset of definitional questions that cannot benefit at all from the WordNet isa-hierarchy, prompting the need to investigate alternative external resources.

[1]  Nina Wacholder,et al.  Disambiguation of Proper Names in Text , 1997, ANLP.

[2]  Dragomir R. Radev,et al.  The Use of Predictive Annotation for Question Answering in TREC8 , 1999, TREC.

[3]  Krzysztof Czuba,et al.  Answering What-Is Questions by Virtual Annotation , 2001, HLT.

[4]  Sanda M. Harabagiu,et al.  FALCON: Boosting Knowledge for Answer Engines , 2000, TREC.

[5]  Yael Ravin,et al.  Identifying and extracting relations from text , 1999 .

[6]  Eduard H. Hovy,et al.  Toward Semantics-Based Answer Pinpointing , 2001, HLT.

[7]  Ellen M. Voorhees,et al.  Building a question answering test collection , 2000, SIGIR '00.

[8]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[9]  Dragomir R. Radev,et al.  Ranking suspected answers to natural language questions using predictive annotation , 2000, ANLP.

[10]  Adwait Ratnaparkhi,et al.  IBM's Statistical Question Answering System , 2000, TREC.

[11]  Jennifer Chu-Carroll,et al.  A Hybrid Approach to Natural Language Web Search , 2002, EMNLP.

[12]  Eric W. Brown,et al.  The GURU System in TREC-6 , 1997, TREC.

[13]  Wei Li,et al.  A Question Answering System Supported by Information Extraction , 2000, ANLP.

[14]  Sanda M. Harabagiu,et al.  The Structure and Performance of an Open-Domain Question Answering System , 2000, ACL.

[15]  Mark Sanderson,et al.  Retrieving descriptive phrases from large amounts of free text , 2000, CIKM '00.

[16]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[17]  Dragomir R. Radev,et al.  Question-answering by predictive annotation , 2000, SIGIR '00.