The Question Answering System of DCUMT in NTCIR-11 QALab

This paper describes the question answering system developed at Dublin City University for participation in the QA Lab shared task in NTCIR-11 [20]. We participated in three tasks: center exam (multiple choice) tasks in Phases 1 and 2, and secondary exam task (written) in Phase 2. We built a QA system in which we use the specialized-purpose parser KBarse to acquire meaning representation which is called case frame graphs from history textbooks using commonsense knowledge. We used distributed representation for Out-Of-Vocaburary (OOV) words and missing assertions. We added prototype functionality for handling implicit arguments/relations, causality analysis, time analysis, and temporal order analysis by heuristics. Our results for center exam task in Phase 1 was 77.0 which was the first among seven submissions, for center exam task in Phase 2 was 72.0 which was the first among nine submissions, and for secondary exam task in Phase 2 in terms of precision were 71.4 (UTokyo), 62.5 (KyotoU), 71.8 (Hokkaido), 62.7 (Waseda), and 80.0 (Chuo) which were the first among two submissions.

[1]  Geoffrey E. Hinton,et al.  Zero-shot Learning with Semantic Output Codes , 2009, NIPS.

[2]  Jeffrey Pennington,et al.  Semi-Supervised Recursive Autoencoders for Predicting Sentiment Distributions , 2011, EMNLP.

[3]  Noriko Kando,et al.  Overview of the NTCIR-11 QA-Lab Task , 2014, NTCIR.

[4]  Daisuke Kawahara,et al.  Acquiring Reliable Predicate-argument Structures from Raw Corpora for Case Frame Compilation , 2010, LREC.

[5]  Christopher Potts,et al.  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank , 2013, EMNLP.

[6]  Raymond J. Mooney,et al.  A Statistical Semantic Parser that Integrates Syntax and Semantics , 2005, CoNLL.

[7]  Quoc V. Le,et al.  Exploiting Similarities among Languages for Machine Translation , 2013, ArXiv.

[8]  Andrew Y. Ng,et al.  Robust Textual Inference via Graph Matching , 2005, HLT.

[9]  Dan Klein,et al.  Learning Dependency-Based Compositional Semantics , 2011, CL.

[10]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[11]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[12]  John B. Lowe,et al.  The Berkeley FrameNet Project , 1998, ACL.

[13]  Percy Liang,et al.  Lambda Dependency-Based Compositional Semantics , 2013, ArXiv.

[14]  Daisuke Kawahara,et al.  Japanese Case Frame Construction by Coupling the Verb and its Closest Case Component , 2001, HLT.

[15]  Andy Way,et al.  DCU Terminology Translation System for Medical Query Subtask at WMT14 , 2014, WMT@ACL.

[16]  Andrew Chou,et al.  Semantic Parsing on Freebase from Question-Answer Pairs , 2013, EMNLP.

[17]  Andrew McCallum,et al.  Relation Extraction with Matrix Factorization and Universal Schemas , 2013, NAACL.

[18]  Joyce Yue Chai,et al.  Semantic Role Labeling of Implicit Arguments for Nominal Predicates , 2012, CL.

[19]  Jun'ichi Tsujii,et al.  Shift-Reduce Dependency DAG Parsing , 2008, COLING.

[20]  Yelong Shen,et al.  Learning semantic representations using convolutional neural networks for web search , 2014, WWW.

[21]  Very Large Corpora.  Empirical Methods in Natural Language Processing , 1999 .

[22]  Hideo Joho,et al.  Overview of NTCIR-11 , 2014, NTCIR.

[23]  Oren Etzioni,et al.  Open Information Extraction: The Second Generation , 2011, IJCAI.