Modeling Reference Interviews as a Basis for Improving Automatic QA Systems

The automatic QA system described in this paper uses a reference interview model to allow the user to guide and contribute to the QA process. A set of system capabilities was designed and implemented that defines how the user's contributions can help improve the system. These include tools, called the Query Template Builder and the Knowledge Base Builder, that tailor the document processing and QA system to a particular domain by allowing a Subject Matter Expert to contribute to the query representation and to the domain knowledge. During the QA process, the system can interact with the user to improve query terminology by using Spell Checking, Answer Type verification, Expansions and Acronym Clarifications. The system also has capabilities that depend upon, and expand the user's history of interaction with the system, including a User Profile, Reference Resolution, and Question Similarity modules

[1]  Tomek Strzalkowski,et al.  A Data Driven Approach to Interactive QA , 2004, New Directions in Question Answering.

[2]  Elizabeth D. Liddy,et al.  Context-based question-answering evaluation , 2004, SIGIR '04.

[3]  Joyce Chai,et al.  Discourse Structure for Context Question Answering , 2004, HLT-NAACL 2004.

[4]  Sanda M. Harabagiu,et al.  Answering Complex, List and Context Questions with LCC's Question-Answering Server , 2001, TREC.

[5]  Edward J. Jennerich.  The Art of the Reference Interview , 1981 .

[6]  Marcia J. Bates,et al.  The design of browsing and berrypicking techniques for the online search interface , 1989 .

[7]  Alan F. Smeaton,et al.  A Study of Selection Noise in Collaborative Web Search , 2005, IJCAI.

[8]  Shigeru Katagiri,et al.  Deriving disambiguous queries in a spoken interactive ODQA system , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[9]  Elizabeth D. Liddy,et al.  What do You Mean? Finding Answers to Complex Questions , 2003, New Directions in Question Answering.

[10]  Elizabeth D. Liddy,et al.  Finding Answers to Complex Questions , 2004, New Directions in Question Answering.

[11]  Suresh Manandhar,et al.  Implementing clarification dialogues in open domain question answering , 2005, Natural Language Engineering.

[12]  Arne Jönsson,et al.  Experiences from Combining Dialogue System Development with Information Extraction Techniques , 2004, New Directions in Question Answering.

[13]  Barry Smyth,et al.  An Analysis of Query Similarity in Collaborative Web Search , 2005, ECIR.