A reasoning enhance network for muti-relation question answering

Multi-relation Question Answering is an important task of knowledge base over question answering (KBQA), multi-relation means that the question contains multiple relations and entity information, so it needs to use the fact triples in the knowledge base to analyze and reasoning the question in more detail. In this paper, we propose a novel model called Reasoning Enhance Network that uses context information, enhance the accuracy of relation and entity predicted in each hop. The model obtains the relation by analyzing the context information before each hop start, and then reasons the answer by the previous information; update question representation and reasoning state through predicted relation and entity, then promote the next hop reasoning starts. Our experiments clearly show that our method achieves good results on four datasets. Also, since we use attention mechanisms, our method offers better interpretability.

[1]  Jens Lehmann,et al.  DBpedia: A Nucleus for a Web of Open Data , 2007, ISWC/ASWC.

[2]  Lun-Wei Ku,et al.  UHop: An Unrestricted-Hop Relation Extraction Framework for Knowledge-Based Question Answering , 2019, NAACL.

[3]  Lei Yu,et al.  Deep Learning for Answer Sentence Selection , 2014, ArXiv.

[4]  Jason Weston,et al.  End-To-End Memory Networks , 2015, NIPS.

[5]  Yelong Shen,et al.  ReasoNet: Learning to Stop Reading in Machine Comprehension , 2016, CoCo@NIPS.

[6]  Ming Zhou,et al.  Gated Self-Matching Networks for Reading Comprehension and Question Answering , 2017, ACL.

[7]  Richard Socher,et al.  Ask Me Anything: Dynamic Memory Networks for Natural Language Processing , 2015, ICML.

[8]  Gerhard Weikum,et al.  Automated Template Generation for Question Answering over Knowledge Graphs , 2017, WWW.

[9]  Hannah Bast,et al.  More Accurate Question Answering on Freebase , 2015, CIKM.

[10]  Hang Li,et al.  Coupling Distributed and Symbolic Execution for Natural Language Queries , 2016, ICML.

[11]  Tom M. Mitchell,et al.  Weakly Supervised Training of Semantic Parsers , 2012, EMNLP.

[12]  Shuohang Wang,et al.  Knowledge Base Question Answering With a Matching-Aggregation Model and Question-Specific Contextual Relations , 2019, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[13]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[14]  Oren Etzioni,et al.  Identifying Relations for Open Information Extraction , 2011, EMNLP.

[15]  Soumen Chakrabarti,et al.  Complex Program Induction for Querying Knowledge Bases in the Absence of Gold Programs , 2019, TACL.

[16]  Christopher Meek,et al.  Semantic Parsing for Single-Relation Question Answering , 2014, ACL.

[17]  Ming Zhou,et al.  Question Answering over Freebase with Multi-Column Convolutional Neural Networks , 2015, ACL.

[18]  Soumen Chakrabarti,et al.  Neural Program Induction for KBQA Without Gold Programs or Query Annotations , 2019, IJCAI.

[19]  Lei Zou,et al.  Answering Natural Language Questions by Subgraph Matching over Knowledge Graphs , 2018, IEEE Transactions on Knowledge and Data Engineering.

[20]  Chen Liang,et al.  Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision , 2016, ACL.

[21]  Eugene Agichtein,et al.  EviNets: Neural Networks for Combining Evidence Signals for Factoid Question Answering , 2017, ACL.

[22]  Ming-Wei Chang,et al.  Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base , 2015, ACL.

[23]  Jason Weston,et al.  Key-Value Memory Networks for Directly Reading Documents , 2016, EMNLP.

[24]  Yunshi Lan,et al.  Query Graph Generation for Answering Multi-hop Complex Questions from Knowledge Bases , 2020, ACL.

[25]  Mohammed J. Zaki,et al.  Bidirectional Attentive Memory Networks for Question Answering over Knowledge Bases , 2019, NAACL.

[26]  Richard Socher,et al.  A Neural Network for Factoid Question Answering over Paragraphs , 2014, EMNLP.

[27]  Jason Weston,et al.  Large-scale Simple Question Answering with Memory Networks , 2015, ArXiv.

[28]  Ryota Tomioka,et al.  Gaussian Attention Model and Its Application to Knowledge Base Embedding and Question Answering , 2016, ArXiv.

[29]  Xiaoyan Zhu,et al.  An Interpretable Reasoning Network for Multi-Relation Question Answering , 2018, COLING.

[30]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[31]  Hongxia Jin,et al.  A Complex KBQA System using Multiple Reasoning Paths , 2020, ArXiv.

[32]  Jason Weston,et al.  Open Question Answering with Weakly Supervised Embedding Models , 2014, ECML/PKDD.

[33]  Jason Weston,et al.  Question Answering with Subgraph Embeddings , 2014, EMNLP.

[34]  Percy Liang,et al.  Compositional Semantic Parsing on Semi-Structured Tables , 2015, ACL.

[35]  Jason Weston,et al.  Translating Embeddings for Modeling Multi-relational Data , 2013, NIPS.

[36]  Zhengdong Lu,et al.  Neural Enquirer: Learning to Query Tables in Natural Language , 2016, IEEE Data Eng. Bull..

[37]  Xifeng Yan,et al.  Recovering Question Answering Errors via Query Revision , 2017, EMNLP.

[38]  Raymond J. Mooney,et al.  Learning Synchronous Grammars for Semantic Parsing with Lambda Calculus , 2007, ACL.

[39]  Nando de Freitas,et al.  A Deep Architecture for Semantic Parsing , 2014, ACL 2014.

[40]  John Miller,et al.  Traversing Knowledge Graphs in Vector Space , 2015, EMNLP.

[41]  Chong Wang,et al.  Scaffolding Networks for Teaching and Learning to Comprehend , 2017, ArXiv.

[42]  Dongyan Zhao,et al.  Question Answering on Freebase via Relation Extraction and Textual Evidence , 2016, ACL.

[43]  Ming-Wei Chang,et al.  The Value of Semantic Parse Labeling for Knowledge Base Question Answering , 2016, ACL.

[44]  Hua Wu,et al.  An End-to-End Model for Question Answering over Knowledge Base with Cross-Attention Combining Global Knowledge , 2017, ACL.

[45]  Gerhard Weikum,et al.  QUINT: Interpretable Question Answering over Knowledge Bases , 2017, EMNLP.

[46]  Alexander Yates,et al.  Large-scale Semantic Parsing via Schema Matching and Lexicon Extension , 2013, ACL.

[47]  Stefan Decker,et al.  TRIPLE - A Query, Inference, and Transformation Language for the Semantic Web , 2002, SEMWEB.