The LogAnswer Project at QA4MRE 2011

For QA4MRE 2012, we have improved our prototype of a pure logic-based answer validation system that was originally developed for QA4MRE 2011. The system uses core functionality of the LogAnswer question answering (QA) system available on the web, which was com- bined and extended such as to best meet the demands of the QA4MRE task. In particular, coreference resolution is used in order to allow knowl- edge processing on the document level, and a fragment of OpenCyc has been integrated in order to allow more exible reasoning. In addition to a general consolidation of the original prototype that took part in QA4MRE 2011, the current system was optimized for accuracy on non- rejected questions. While last year's system only achieved an accuracy of 0.24 for answered questions, the various measures taken to improve the rejection decision now yield an accuracy of 0.31 for answered questions in the QA4MRE 2012 task. Results show that these improvements were sucient

[1]  Ingo Glöckner,et al.  The LogAnswer Project at ResPubliQA 2010 , 2010, CLEF.

[2]  Ulrich Furbach,et al.  An application of automated reasoning in natural language question answering , 2010, AI Commun..

[3]  Carol Peters,et al.  Evaluating Systems for Multilingual and Multimodal Information Access, 9th Workshop of the Cross-Language Evaluation Forum, CLEF 2008, Aarhus, Denmark, September 17-19, 2008, Revised Selected Papers , 2009, CLEF.

[4]  Ingo Gl.  University of Hagen at QA@CLEF 2006: Answer Validation Exercise , 2006 .

[5]  Sven Hartrumpf,et al.  Hybrid disambiguation in natural language analysis , 2003 .

[6]  Ingo Glöckner,et al.  Combining Logic and Machine Learning for Answering Questions , 2008, CLEF.

[7]  Ingo Glöckner,et al.  The LogAnswer Project at CLEF 2009 , 2009, CLEF.

[8]  Sven Hartrumpf,et al.  The semantically based computer lexicon HaGenLex. Structure and technological environment , 2003 .

[9]  Hermann Helbig,et al.  Knowledge Representation and the Semantics of Natural Language , 2005, Cognitive Technologies.

[10]  Eduard H. Hovy,et al.  Overview of QA4MRE at CLEF 2011: Question Answering for Machine Reading Evaluation , 2011, CLEF.

[11]  Carol Peters,et al.  Evaluating Systems for Multilingual and Multimodal Information Access: 9th Workshop of the Cross-Language Evaluation Forum, CLEF 2008, Aarhus, Denmark, ... Applications, incl. Internet/Web, and HCI) , 2009 .

[12]  Tiansi Dong,et al.  A Natural Language Question Answering System as a Participant in Human Q&A Portals , 2011, IJCAI.

[13]  Tiansi Dong,et al.  LogAnswer in Question Answering Forums , 2011, ICAART.