English Run of Synapse Développement at Entrance Exams 2014

This article presents the participation of Synapse Developpement to the CLEF 2014 Entrance Exam campaign (QA track). Since fifteen years, our company works on Question Answering domain. Recently our work concen- trated on Machine Reading and Natural Language understanding. Thus, the En- trance Exam evaluation was an excellent opportunity to measure the results of this work. The developed system is based on a deep syntactic and semantic analysis with anaphora resolution. The results of this analysis are saved in so- phisticated structures based on clause description (CDS = Clause Description Structure). For this evaluation, we added a dedicated module to compare CDS from texts, questions and answers. This module measures the degree of corre- spondence between these elements, taking into account the type of question, which means the type of answer awaited. We participate in English and French languages; this article focuses on the English run, comparing it with the French run whose final results were better. However our run for English obtains the best results in this language.

[1]  Yorick Wilks,et al.  Natural language inference. , 1973 .

[2]  Marc Weedon-Newstead,et al.  Review"Testing Listening Comprehension In Japanese University Entrance Examinations" , 1990 .

[3]  Ellen Riloff,et al.  A Rule-based Question Answering System for Reading Comprehension Tests , 2000 .

[4]  Dominique Laurent,et al.  Cross Lingual Question Answering using QRISTAL for CLEF 2008 , 2006, CLEF.

[5]  Christopher D. Manning,et al.  Natural language inference , 2009 .

[6]  Olivier Galibert,et al.  Question Answering on Web Data: The QA Evaluation in Quæro , 2010, LREC.

[7]  Eduard H. Hovy,et al.  Overview of QA4MRE at CLEF 2011: Question Answering for Machine Reading Evaluation , 2011, CLEF.

[8]  Anselmo Peñas,et al.  A Simple Measure to Assess Non-response , 2011, ACL.

[9]  Eduard H. Hovy,et al.  Evaluating Machine Reading Systems through Comprehension Tests , 2012, LREC.

[10]  Mette Skov,et al.  CLEF 2013 Evaluation Labs and Workshop, Online Working Notes , 2013 .

[11]  Somnath Banerjee,et al.  Multiple Choice Question (MCQ) Answering System for Entrance Examination , 2013, CLEF.

[12]  Yusuke Miyao,et al.  Question Answering System for Entrance Exams in QA4MRE , 2013, CLEF.

[13]  Tomoki Toda,et al.  NAIST at the CLEF 2013 QA4MRE Pilot Task , 2013, CLEF.

[14]  Adrian Iftene,et al.  Using Anaphora Resolution in a Question Answering System for Machine Reading Evaluation , 2013, CLEF.

[15]  Mandana GhaffarzadehKhoei.  An Investigation of Method Effects on Reading Comprehension Test Performance , 2015 .

[16]  A Myth of Influence : Japanese University Entrance Exams and Their Effect on Junior and Senior High , .