Dependency-Based Algorithms for Answer Validation Task in Russian Question Answering

This paper discusses the Answer Validation Task in Question Answering applied for Russian language. Due to poor language resources we are limited in selection of techniques for Question Answering. Dependency parse-based methods applied to factoid questions are in the primary focus. We notice that existing works use either pure syntactic dependency parsers or parsers which perform some extra shallow semantic analysis for English. The selection of either of the parsers is not justified in any of these works. We report experiments for Russian language in absence of WordNet on various combinations of rule-based parsers and graph matching algorithms, including our Parallel Graphs Traversal algorithm first published in ROMIP 2010 [23]. Performance is evaluated using a subset of ROMIP questions collection with ten-fold cross-validation.

[1]  John M. Prager,et al.  Open-Domain Question-Answering , 2007, Found. Trends Inf. Retr..

[2]  Diego Mollá Aliod,et al.  Recognizing Textual Entailment Via Atomic Propositions , 2005, MLCW.

[3]  Carol Peters,et al.  Evaluating Systems for Multilingual and Multimodal Information Access, 9th Workshop of the Cross-Language Evaluation Forum, CLEF 2008, Aarhus, Denmark, September 17-19, 2008, Revised Selected Papers , 2009, CLEF.

[4]  Yang Tang,et al.  THU QUANTA at TAC 2009 KBP and RTE Track , 2009, TAC.

[5]  Bernardo Magnini,et al.  Is It the Right Answer? Exploiting Web Redundancy for Answer Validation , 2002, ACL.

[6]  Kaizhong Zhang,et al.  Simple Fast Algorithms for the Editing Distance Between Trees and Related Problems , 1989, SIAM J. Comput..

[7]  Somnath Banerjee,et al.  A Hybrid Question Answering System based on Information Retrieval and Answer Validation , 2011, CLEF.

[8]  M. Felisa Verdejo,et al.  Overview of the Answer Validation Exercise 2007 , 2006, CLEF.

[9]  Pieter W. Adriaans,et al.  Using Maximal Embedded Syntactic Subtrees for Textual Entailment Recognition , 2006 .

[10]  Sanda M. Harabagiu,et al.  LASSO: A Tool for Surfing the Answer Net , 1999, TREC.

[11]  Abraham Ittycheriah,et al.  A Statistical Approach For Open Domain Question Answering , 2008 .

[12]  Anne-Laure Ligozat,et al.  Lexical validation of answers in Question Answering , 2007, IEEE/WIC/ACM International Conference on Web Intelligence (WI'07).

[13]  Dan Roth,et al.  Mapping Dependencies Trees: An Application to Question Answering , 2003 .

[14]  Günter Neumann,et al.  Using Recognizing Textual Entailment as a Core Engine for Answer Validation , 2008, CLEF.

[15]  Dan I. Moldovan,et al.  Some Advanced Features Of Cc's Poweranswer , 2008 .

[16]  Emiel Krahmer,et al.  Normalized alignment of dependency trees for detecting textual entailment , 2006 .

[17]  Wei Ding,et al.  Parsing Tree Matching Based Question Answering , 2008, TAC.

[18]  Sanda M. Harabagiu,et al.  Advances in Open Domain Question Answering , 2007 .

[19]  Daniel Jurafsky,et al.  Shallow Semantic Parsing using Support Vector Machines , 2004, NAACL.

[20]  Anselmo Peñas,et al.  A Simple Measure to Assess Non-response , 2011, ACL.

[21]  John Prager.  Open-Domain Question Answering: Foundations and Trends(R) in Information Retrieval , 2007 .

[22]  Peter Clark,et al.  The Seventh PASCAL Recognizing Textual Entailment Challenge , 2011, TAC.

[23]  Rafael Muñoz,et al.  DLSITE-2: Semantic Similarity Based on Syntactic Dependency Trees Applied to Textual Entailment , 2007 .