Textual Inference with Tree-Structured LSTM

Textual Inference is a research trend in Natural Language Processing (NLP) that has recently received a lot of attention by the scientific community. Textual Entailment (TE) is a specific task in Textual Inference that aims at determining whether a hypothesis is entailed by a text. This paper employs the Child-Sum Tree-LSTM for solving the challenging problem of textual entailment. Our approach is simple and able to generalize well without excessive parameter optimization. Evaluation done on SNLI, SICK and other TE datasets shows the competitiveness of our approach.

[1]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[2]  Mirella Lapata,et al.  Long Short-Term Memory-Networks for Machine Reading , 2016, EMNLP.

[3]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[4]  Luigi Di Caro,et al.  NORMAS at SemEval-2016 Task 1: SEMSIM: A Multi-Feature Approach to Semantic Text Similarity , 2016, *SEMEVAL.

[5]  Livio Robaldo,et al.  Linking legal open data: breaking the accessibility and language barrier in european legislation and case law , 2015, ICAIL.

[6]  Fabio Massimo Zanzotto,et al.  Expanding textual entailment corpora fromWikipedia using co-training , 2010, PWNLP@COLING.

[7]  Ido Dagan,et al.  Recognizing textual entailment: Rational, evaluation and approaches – Erratum , 2010, Natural Language Engineering.

[8]  Pengfei Liu,et al.  Modelling Interaction of Sentence Pair with Coupled-LSTMs , 2016, EMNLP.

[9]  Randy Goebel,et al.  A Convolutional Neural Network in Legal Question Answering , 2015 .

[10]  Christopher Potts,et al.  A large annotated corpus for learning natural language inference , 2015, EMNLP.

[11]  Sivaji Bandyopadhyay,et al.  Recognizing Textual Entailment Using a Machine Learning Approach , 2010, MICAI.

[12]  Phil Blunsom,et al.  Reasoning about Entailment with Neural Attention , 2015, ICLR.

[13]  Danqi Chen,et al.  A Fast and Accurate Dependency Parser using Neural Networks , 2014, EMNLP.

[14]  Ion Androutsopoulos,et al.  A Survey of Paraphrasing and Textual Entailment Methods , 2009, J. Artif. Intell. Res..

[15]  Zhen-Hua Ling,et al.  Enhancing and Combining Sequential and Tree LSTM for Natural Language Inference , 2016, ArXiv.

[16]  Zhen-Hua Ling,et al.  Enhanced LSTM for Natural Language Inference , 2016, ACL.

[17]  Mi-Young Kim,et al.  Legal Question Answering Using Ranking SVM and Syntactic/Semantic Similarity , 2014, JSAI-isAI Workshops.

[18]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[19]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[20]  Jakob Uszkoreit,et al.  A Decomposable Attention Model for Natural Language Inference , 2016, EMNLP.

[21]  Hong Yu,et al.  Neural Semantic Encoders , 2016, EACL.

[22]  Ido Dagan,et al.  The Third PASCAL Recognizing Textual Entailment Challenge , 2007, ACL-PASCAL@ACL.

[23]  Bowen Zhou,et al.  Applying deep learning to answer selection: A study and an open task , 2015, 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU).

[24]  Jeffrey Pennington,et al.  Dynamic Pooling and Unfolding Recursive Autoencoders for Paraphrase Detection , 2011, NIPS.

[25]  Jan Pichl,et al.  Sentence Pair Scoring: Towards Unified Framework for Text Comprehension , 2016, 1603.06127.

[26]  Jason Weston,et al.  Memory Networks , 2014, ICLR.

[27]  Peter Clark,et al.  The Seventh PASCAL Recognizing Textual Entailment Challenge , 2011, TAC.

[28]  Zhifang Sui,et al.  Recognizing Textual Entailment Using Probabilistic Inference , 2015, EMNLP.

[29]  Bowen Zhou,et al.  ABCNN: Attention-Based Convolutional Neural Network for Modeling Sentence Pairs , 2015, TACL.

[30]  Yang Liu,et al.  Learning Natural Language Inference using Bidirectional LSTM model and Inner-Attention , 2016, ArXiv.

[31]  Livio Robaldo,et al.  A system for classifying multi-label text into EuroVoc , 2013, ICAIL.

[32]  Livio Robaldo,et al.  Eunomos, a legal document and knowledge management system for the Web to provide relevant, reliable and up-to-date information on the law , 2016, Artificial Intelligence and Law.

[33]  Livio Robaldo,et al.  Semantic Relation Extraction from Legislative Text Using Generalized Syntactic Dependencies and Support Vector Machines , 2013, RuleML.

[34]  Christopher D. Manning,et al.  Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks , 2015, ACL.

[35]  Bowen Zhou,et al.  LSTM-based Deep Learning Models for non-factoid answer selection , 2015, ArXiv.

[36]  Zhiguo Wang,et al.  Bilateral Multi-Perspective Matching for Natural Language Sentences , 2017, IJCAI.