Recognizing Textual Entailment Challenge Organizers Recognising Textual Entailment Challenge Workshop Program Application of the Bleu Algorithm for Recognising Textual Entailments What Syntax Can Contribute in Entailment Task Recognizing Textual Entailment with Edit Distance Algorithms Textual Entai

This paper describes the PASCAL Network of Excellence Recognising Textual Entailment (RTE) Challenge benchmark 1 . The RTE task is defined as recognizing, given two text fragments, whether the meaning of one text can be inferred (entailed) from the other. This applicationindependent task is suggested as capturing major inferences about the variability of semantic expression which are commonly needed across multiple applications. The Challenge has raised noticeable attention in the research community, attracting 17 submissions from diverse groups, suggesting the generic relevance of the task.

[1]  H. Kuhn.  The Hungarian method for the assignment problem , 1955 .

[2]  Richard Edwin Stearns,et al.  Syntax-Directed Transduction , 1966, JACM.

[3]  R. K. Lindsay.  What Computers Can't Do. A Critique of Artificial Reason. Hubert L. Dreyfus. Harper and Row, New York, 1972. xxxvi, 260 pp. $8.95 , 1972 .

[4]  Larry Wos,et al.  Automated reasoning - 33 basic research problems , 1988 .

[5]  Richard A. Harshman,et al.  Indexing by Latent Semantic Analysis , 1990, J. Am. Soc. Inf. Sci..

[6]  Daniel Dominic Sleator,et al.  Parsing English with a Link Grammar , 1995, IWPT.

[7]  Robert L. Mercer,et al.  The Mathematics of Statistical Machine Translation: Parameter Estimation , 1993, CL.

[8]  Uwe Reyle,et al.  From Discourse to Logic - Introduction to Modeltheoretic Semantics of Natural Language, Formal Logic and Discourse Representation Theory , 1993, Studies in linguistics and philosophy.

[9]  Dekai Wu,et al.  An Algorithm for Simultaneously Bracketing Parallel Texts by Aligning Words , 1995, ACL.

[10]  Stephen Pulman,et al.  Using the Framework , 1996 .

[11]  Adwait Ratnaparkhi,et al.  A Maximum Entropy Model for Part-Of-Speech Tagging , 1996, EMNLP.

[12]  Dekai Wu,et al.  Stochastic Inversion Transduction Grammars and Bilingual Parsing of Parallel Corpora , 1997, CL.

[13]  Dekang Lin,et al.  An Information-Theoretic Definition of Similarity , 1998, ICML.

[14]  Lynette Hirschman,et al.  Deep Read: A Reading Comprehension System , 1999, ACL.

[15]  Chung Hee Hwang,et al.  Episodic Logic Meets Little Red Riding Hood: A Comprehensive, Natural Representation for Language Un , 2000 .

[16]  김동규,et al.  [서평]「Algorithms on Strings, Trees, and Sequences」 , 2000 .

[17]  Sanda M. Harabagiu,et al.  Experiments with Open-Domain Textual Question Answering , 2000, COLING.

[18]  Sanda M. Harabagiu,et al.  The Structure and Performance of an Open-Domain Question Answering System , 2000, ACL.

[19]  James H. Martin,et al.  Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition , 2000 .

[20]  Daniel Gildea,et al.  Automatic Labeling of Semantic Roles , 2000, ACL.

[21]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[22]  Vasile Rus,et al.  Logic Form Transformation of WordNet and its Applicability to Question Answering , 2001, ACL.

[23]  Hwee Tou Ng,et al.  A Machine Learning Approach to Coreference Resolution of Noun Phrases , 2001, CL.

[24]  M. de Rijke,et al.  Light-Weight Entailment Checking for Computational Semantics , 2001 .

[25]  Patrick Pantel,et al.  DIRT @SBT@discovery of inference rules from text , 2001, KDD '01.

[26]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[27]  Thorsten Joachims,et al.  Learning to classify text using support vector machines - methods, theory and algorithms , 2002, The Kluwer international series in engineering and computer science.

[28]  H. Cunningham,et al.  A framework and graphical development environment for robust NLP tools and applications. , 2002, ACL 2002.

[29]  George A. Miller,et al.  WordNet: A Lexical Database for the English Language , 2002 .

[30]  Ca'Garzoni-Moro.  GETARUN PARSER A parser equipped with Quantifier Raising and Anaphoric Binding based on LFG , 2002 .

[31]  Ted Briscoe,et al.  Robust Accurate Statistical Annotation of General Text , 2002, LREC.

[32]  Andrei Voronkov,et al.  The design and implementation of VAMPIRE , 2002, AI Commun..

[33]  Sanda M. Harabagiu,et al.  LCC Tools for Question Answering , 2002, TREC.

[34]  Dan I. Moldovan,et al.  Lexical Chains for Question Answering , 2002, COLING.

[35]  Michael Collins,et al.  New Ranking Algorithms for Parsing and Tagging: Kernels over Discrete Structures, and the Voted Perceptron , 2002, ACL.

[36]  Regina Barzilay,et al.  Learning to Paraphrase: An Unsupervised Approach Using Multiple-Sequence Alignment , 2003, NAACL.

[37]  Ralf Krestel,et al.  {Using Knowledge-poor Coreference Resolution for Text Summarization} , 2003 .

[38]  Satoshi Sekine,et al.  Paraphrase Acquisition for Information Extraction , 2003, IWP@ACL.

[39]  H. Ney,et al.  A novel string-to-string distance measure with applications to machine translation evaluation , 2003, MTSUMMIT.

[40]  Dan Klein,et al.  Accurate Unlexicalized Parsing , 2003, ACL.

[41]  Sanda M. Harabagiu,et al.  COGEX: A Logic Prover for Question Answering , 2003, NAACL.

[42]  Eduard H. Hovy,et al.  Automatic Evaluation of Summaries Using N-gram Co-occurrence Statistics , 2003, NAACL.

[43]  Koen Claessen,et al.  New techniques that improve mace-style model nding , 2003 .

[44]  Hermann Ney,et al.  A Systematic Comparison of Various Statistical Alignment Models , 2003, CL.

[45]  Hermann Ney,et al.  A Comparative Study on Reordering Constraints in Statistical Machine Translation , 2003, ACL.

[46]  René Witte,et al.  Fuzzy Coreference Resolution for Summarization , 2003 .

[47]  Patrick Pantel,et al.  VerbOcean: Mining the Web for Fine-Grained Semantic Verb Relations , 2004, EMNLP.

[48]  James Henderson,et al.  Discriminative Training of a Neural Network Statistical Parser , 2004, ACL.

[49]  Horacio Saggion,et al.  Exploring the Performance of Boolean Retrieval Strategies for Open Domain Question Answering , 2004 .

[50]  Mark Steedman,et al.  Wide-Coverage Semantic Representations from a CCG Parser , 2004, COLING.

[51]  Ido Dagan,et al.  Scaling Web-based Acquisition of Entailment Relations , 2004, EMNLP.

[52]  Eric K. Ringger,et al.  Using the Penn Treebank to Evaluate Non-Treebank Parsers , 2004, LREC.

[53]  Ted Pedersen,et al.  WordNet::Similarity - Measuring the Relatedness of Concepts , 2004, NAACL.

[54]  Daniel Jurafsky,et al.  Semantic Role Labeling by Tagging Syntactic Chunks , 2004, CoNLL.

[55]  Graeme Hirst,et al.  Semantic distance in WordNet: An experimental, application-oriented evaluation of five measures , 2004 .

[56]  Dan Roth,et al.  Natural Language Inference via Dependency Tree Mapping: An Application to Question Answering , 2004 .

[57]  Taro Watanabe,et al.  Reordering Constraints for Phrase-Based Statistical Machine Translation , 2004, COLING.

[58]  Daniel Gildea,et al.  Syntax-Based Alignment: Supervised or Unsupervised? , 2004, COLING.

[59]  Ido Dagan,et al.  PROBABILISTIC TEXTUAL ENTAILMENT: GENERIC APPLIED MODELING OF LANGUAGE VARIABILITY , 2004 .

[60]  René Witte,et al.  Multi-ERSS and ERSS 2004 , 2004 .

[61]  Christopher D. Manning,et al.  Joint Learning Improves Semantic Role Labeling , 2005, ACL.

[62]  Dan I. Moldovan,et al.  Semantic disambiguation of wordnet glosses and lexical chains on extended wordnet , 2005 .

[63]  Pascale Fung,et al.  Inversion Transduction Grammar Constraints for Mining Parallel Sentences from Quasi-Comparable Corpora , 2005, IJCNLP.