论文信息 - Question Answering Challenge for Five Ranked Answers and List Answers - Overview of NTCIR4 QAC2 Subtask 1 and 2

Question Answering Challenge for Five Ranked Answers and List Answers - Overview of NTCIR4 QAC2 Subtask 1 and 2

In this paper we describe an evaluation of question answering task, Question Answering Challenge 2 (QAC2). This evaluation project was r st carried out at the NTCIR Workshop 3 in October 2002. One objective of the QAC was to develop practical QA systems in a general domain by focusing on research relating to user interaction and information extraction. Our second objective was to develop an evaluation method for the question answering system and information resources for evaluation. We den ed three kinds of tasks in the QAC2 as well as QAC1: Subtask 1, where questions required ve possible answers in some order, Subtask 2, where questions had one list of answers and Subtask 3, where there were a series of questions. This paper describes the evaluation overview of Subtask 1 and 2. We prepared 200 questions for Subtask 1 and Subtask 2. We conducted only Formal Run for these two subtasks. There were 18 active participants: 25 system submissions for subtask 1 from 16 participants and 14 system submissions for subtask 2 from 9 participants.

Tsuneaki Kato | Jun-ichi Fukumoto | Fumito Masui

[1] Ellen M. Voorhees,et al. Building a question answering test collection , 2000, SIGIR '00.

[2] Tsuneaki Kato,et al. An Overview of Question and Answering Challenge (QAC) of the Next NTCIR Workshop , 2001, NTCIR.

[3] Tsuneaki Kato,et al. Question Answering Challenge (QAC-1): An Evaluation of Question Answering Tasks at the NTCIR Workshop 3 , 2003, New Directions in Question Answering.