Textual Inference with Tree-structured LSTMs 1

Textual Inference is a research trend in Natural Language Processing (NLP) that has recently received a lot of attention by the scientific community. Textual Entailment (TE) is a specific task in Textual Inference that aims at determining whether a hypothesis is entailed by a text. Usually tackled by machine learning techniques employing features which represent similarity between texts, the recent availability of more training data presupposes that Neural Networks that are able to learn latent feature from data for generalized prediction could be employed. This paper employs the Child-Sum TreeLSTM for solving the challenging problem of textual entailment. Our approach is simple and able to generalize well without excessive parameter optimization. Evaluation done on SNLI, SICK and other TE datasets shows the competitiveness of our approach.

[1]  Livio Robaldo,et al.  Eunomos, a legal document and knowledge management system for the Web to provide relevant, reliable and up-to-date information on the law , 2016, Artificial Intelligence and Law.

[2]  Luigi Di Caro,et al.  NORMAS at SemEval-2016 Task 1: SEMSIM: A Multi-Feature Approach to Semantic Text Similarity , 2016, *SEMEVAL.

[3]  Jan Pichl,et al.  Sentence Pair Scoring: Towards Unified Framework for Text Comprehension , 2016, 1603.06127.

[4]  Phil Blunsom,et al.  Reasoning about Entailment with Neural Attention , 2015, ICLR.

[5]  Eneko Agirre,et al.  SemEval-2016 Task 1: Semantic Textual Similarity, Monolingual and Cross-Lingual Evaluation , 2016, *SEMEVAL.

[6]  Bowen Zhou,et al.  LSTM-based Deep Learning Models for non-factoid answer selection , 2015, ArXiv.

[7]  Xiang Zhang,et al.  Character-level Convolutional Networks for Text Classification , 2015, NIPS.

[8]  Christopher Potts,et al.  A large annotated corpus for learning natural language inference , 2015, EMNLP.

[9]  Bowen Zhou,et al.  Applying deep learning to answer selection: A study and an open task , 2015, 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU).

[10]  Livio Robaldo,et al.  Linking legal open data: breaking the accessibility and language barrier in european legislation and case law , 2015, ICAIL.

[11]  Christopher D. Manning,et al.  Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks , 2015, ACL.

[12]  Randy Goebel,et al.  A Convolutional Neural Network in Legal Question Answering , 2015 .

[13]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[14]  Alexander F. Gelbukh,et al.  UNAL-NLP: Combining Soft Cardinality Features for Semantic Textual Similarity, Relatedness and Entailment , 2014, *SEMEVAL.

[15]  Günter Neumann,et al.  The Excitement Open Platform for Textual Inferences , 2014, ACL.

[16]  Phil Blunsom,et al.  A Convolutional Neural Network for Modelling Sentences , 2014, ACL.

[17]  Danqi Chen,et al.  A Fast and Accurate Dependency Parser using Neural Networks , 2014, EMNLP.

[18]  Livio Robaldo,et al.  Semantic Relation Extraction from Legislative Text Using Generalized Syntactic Dependencies and Support Vector Machines , 2013, RuleML.

[19]  Chris Brew,et al.  SemEval-2013 Task 7: The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge , 2013, *SEMEVAL.

[20]  Livio Robaldo,et al.  A system for classifying multi-label text into EuroVoc , 2013, ICAIL.

[21]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[22]  Stefan C. Kremer,et al.  Recurrent Neural Networks , 2013, Handbook on Neural Information Processing.

[23]  Jeffrey Pennington,et al.  Dynamic Pooling and Unfolding Recursive Autoencoders for Paraphrase Detection , 2011, NIPS.

[24]  Peter Clark,et al.  The Seventh PASCAL Recognizing Textual Entailment Challenge , 2011, TAC.

[25]  Sivaji Bandyopadhyay,et al.  Recognizing Textual Entailment Using a Machine Learning Approach , 2010, MICAI.

[26]  Ido Dagan,et al.  Recognizing textual entailment: Rational, evaluation and approaches – Erratum , 2010, Natural Language Engineering.

[27]  Ido Dagan,et al.  Evaluating the Inferential Utility of Lexical-Semantic Resources , 2009, EACL.

[28]  Ido Dagan,et al.  The Sixth PASCAL Recognizing Textual Entailment Challenge , 2009, TAC.

[29]  Ido Dagan,et al.  The Third PASCAL Recognizing Textual Entailment Challenge , 2007, ACL-PASCAL@ACL.

[30]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.