论文信息 - An Overview of the 4th Question Answering Challenge (QAC-4) at NTCIR Workshop 6

An Overview of the 4th Question Answering Challenge (QAC-4) at NTCIR Workshop 6

In QAC-4, we defined question answering task using any type of question, mainly focused on non-factoid questions. There are 8 participants and 14 runs from these participants. In the evaluation, four kinds of criterion were used for some portion of participants answer set. The evaluation results showed some of the participant systems could focus on the area which correct answer contents exist but have tendency to fail to extract correct answer areas. It is caused by complex question types and difficulty of correct answer scope extraction.

Tsuneaki Kato | Tatsunori Mori | Jun-ichi Fukumoto | Fumito Masui

[1] Tsuneaki Kato,et al. An Overview of NTCIR-5 QAC3 , 2005, NTCIR.

[2] Tsuneaki Kato,et al. Question Answering Challenge (QAC-1): An Evaluation of Question Answering Tasks at the NTCIR Workshop 3 , 2003, New Directions in Question Answering.

[3] Tsuneaki Kato,et al. Handling Information Access Dialogue through QA Technologies - A novel challenge for open-domain question answering , 2004 .

[4] Tsuneaki Kato,et al. Question Answering Challenge for Information Access Dialogue - Overview of NTCIR4 QAC2 Subtask , 2004, NTCIR.

[5] Tsuneaki Kato,et al. Question Answering Challenge for Five Ranked Answers and List Answers - Overview of NTCIR4 QAC2 Subtask 1 and 2 , 2004, NTCIR.