Incorporating Image Matching Into Knowledge Acquisition for Event-Oriented Relation Recognition

Event relation recognition is a challenging language processing task. It is required to determine the relation class of a pair of query events, such as causality, under the condition that there isn’t any reliable clue for use. We follow the traditional statistical approach in this paper, speculating the relation class of the target events based on the relation-class distributions on the similar events. There is minimal supervision used during the speculation process. In particular, we incorporate image processing into the acquisition of similar event instances, including the utilization of images for visually representing event scenes, and the use of the neural network based image matching for approximate calculation between events. We test our method on the ACE-R2 corpus and compared our model with the fully-supervised neural network models. Experimental results show that we achieve a comparable performance to CNN while slightly better than LSTM.

[1]  Mirella Lapata,et al.  Learning Sentence-internal Temporal Relations , 2006, J. Artif. Intell. Res..

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Dan I. Moldovan,et al.  Causal Relation Extraction , 2008, LREC.

[4]  Xiaocheng Feng,et al.  A language-independent neural network for event detection , 2018, ACL.

[5]  Yuji Matsumoto,et al.  NAIST.Japan: Temporal Relation Identification Using Dependency Parsed Tree , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[6]  Steven Bethard,et al.  ClearTK-TimeML: A minimalist approach to TempEval 2013 , 2013, *SEMEVAL.

[7]  Suryakanth V. Gangashetty,et al.  An Investigation of Recurrent Neural Network Architectures Using Word Embeddings for Phrase Break Prediction , 2016, INTERSPEECH.

[8]  Xiang Zhang,et al.  Automatically Labeled Data Generation for Large Scale Event Extraction , 2017, ACL.

[9]  Jong-Hoon Oh,et al.  Generating Event Causality Hypotheses through Semantic Relations , 2015, AAAI.

[10]  Yang Liu,et al.  Recognizing Implicit Discourse Relations via Repeated Reading: Neural Networks with Multi-Level Attention , 2016, EMNLP.

[11]  Yang Liu,et al.  Implicit Discourse Relation Classification via Multi-Task Neural Networks , 2016, AAAI.

[12]  Hwee Tou Ng,et al.  Recognizing Implicit Discourse Relations in the Penn Discourse Treebank , 2009, EMNLP.

[13]  Roxana Gîrju,et al.  Automatic Detection of Causal Relations for Question Answering , 2003, ACL 2003.

[14]  Yuji Matsumoto,et al.  Acquiring causal knowledge from text using the connective marker tame , 2005, TALIP.

[15]  Munirathnam Srikanth,et al.  LCC-TE: A Hybrid Approach to Temporal Relation Identification in News Text , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[16]  Mark A. Przybocki,et al.  The Automatic Content Extraction (ACE) Program – Tasks, Data, and Evaluation , 2004, LREC.

[17]  James Pustejovsky,et al.  SemEval-2007 Task 15: TempEval Temporal Relation Identification , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[18]  Heng Ji,et al.  Building a Cross-document Event-Event Relation Corpus , 2016, LAW@ACL.

[19]  Pierre Nugues,et al.  A High-Performance Syntactic and Semantic Dependency Parser , 2010, COLING.

[20]  Kira Radinsky,et al.  Learning causality for news events prediction , 2012, WWW.

[21]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[22]  Dan I. Moldovan,et al.  Text Mining for Causal Relations , 2002, FLAIRS.

[23]  Jun Zhao,et al.  Exploiting Argument Information to Improve Event Detection via Supervised Attention Mechanisms , 2017, ACL.

[24]  James Pustejovsky,et al.  SemEval-2010 Task 13: Evaluating Events, Time Expressions, and Temporal Relations (TempEval-2) , 2009, SEW@NAACL-HLT.

[25]  Dan Roth,et al.  Minimally Supervised Event Causality Identification , 2011, EMNLP.

[26]  James H. Martin,et al.  CU-TMP: Temporal Relation Classification Using Syntactic and Semantic Features , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[27]  Pascal Denis,et al.  Learning Connective-based Word Representations for Implicit Discourse Relation Identification , 2016, EMNLP.

[28]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[29]  David Ahn,et al.  The stages of event extraction , 2006 .

[30]  Robert J. Gaizauskas,et al.  USFD: Preliminary Exploration of Features and Classifiers for the TempEval-2007 Task , 2007, SemEval@ACL.

[31]  Ralph Grishman,et al.  Modeling Skip-Grams for Event Detection with Convolutional Neural Networks , 2016, EMNLP.

[32]  Hai Zhao,et al.  A Stacking Gated Neural Architecture for Implicit Discourse Relation Classification , 2016, EMNLP.

[33]  Hai Zhao,et al.  Adversarial Connective-exploiting Networks for Implicit Discourse Relation Classification , 2017, ACL.

[34]  Nianwen Xue,et al.  Discovering Implicit Discourse Relations Through Brown Cluster Pair Representation and Coreference Patterns , 2014, EACL.

[35]  Danielle L. Mowery,et al.  BluLab: Temporal Information Extraction for the 2015 Clinical TempEval Challenge , 2015, *SEMEVAL.

[36]  Livio Robaldo,et al.  The Penn Discourse Treebank 2.0 Annotation Manual , 2007 .

[37]  James F. Allen,et al.  TRIPS and TRIOS System for TempEval-2: Extracting Temporal Information from Text , 2010, *SEMEVAL.

[38]  Paramita Mirza,et al.  HLT-FBK: a Complete Temporal Processing System for QA TempEval , 2015, *SEMEVAL.

[39]  Qiaoming Zhu,et al.  Combining Event-Level and Cross-Event Semantic Information for Event-Oriented Relation Classification by SCNN , 2016, CCL.

[40]  Estela Saquete Boró,et al.  TIPSem (English and Spanish): Evaluating CRFs and Semantic Roles in TempEval-2 , 2010, *SEMEVAL.

[41]  James Pustejovsky,et al.  Machine Learning of Temporal Relations , 2006, ACL.

[42]  Gosse Bouma,et al.  Extracting Explicit and Implicit Causal Relations from Sparse, Domain-Specific Texts , 2011, NLDB.

[43]  Zhiyi Song,et al.  Overview of Linguistic Resources for the TAC KBP 2017 Evaluations: Methodologies and Results , 2017, TAC.

[44]  Yaojie Lu,et al.  Shallow Convolutional Neural Network for Implicit Discourse Relation Recognition , 2015, EMNLP.

[45]  Ani Nenkova,et al.  Using entity features to classify implicit discourse relations , 2010, SIGDIAL Conference.

[46]  Dan Roth,et al.  Event Detection and Co-reference with Minimal Supervision , 2016, EMNLP.

[47]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[48]  Wei Shi,et al.  Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification , 2016, ACL.

[49]  Du-Seong Chang,et al.  Causal Relation Extraction Using Cue Phrase and Lexical Pair Probabilities , 2004, IJCNLP.

[50]  Yidong Chen,et al.  Improving Implicit Discourse Relation Recognition with Discourse-specific Word Embeddings , 2017, ACL.

[51]  Tommaso Caselli,et al.  SPINOZA_VU: An NLP Pipeline for Cross Document TimeLines , 2015, SemEval@NAACL-HLT.

[52]  Georgiana Puscasu.  WVALI: Temporal Relation Identification by Syntactico-Semantic Analysis , 2007, SemEval@ACL.

[53]  Xiaoli Z. Fern,et al.  Event Nugget Detection with Forward-Backward Recurrent Neural Networks , 2016, ACL.

[54]  Claire Cardie,et al.  Improving Implicit Discourse Relation Recognition Through Feature Set Optimization , 2012, SIGDIAL Conference.

[55]  Ani Nenkova,et al.  Using Syntax to Disambiguate Explicit Discourse Connectives in Text , 2009, ACL.

[56]  Yuji Matsumoto,et al.  Acquiring Event Relation Knowledge by Learning Cooccurrence Patterns and Fertilizing Cooccurrence Samples with Verbal Nouns , 2008, IJCNLP.

[57]  Nianwen Xue,et al.  Improving the Inference of Implicit Discourse Relations via Classifying Explicit Discourse Connectives , 2015, NAACL.

[58]  Anna Korhonen,et al.  Event-Related Features in Feedforward Neural Networks Contribute to Identifying Causal Relations in Discourse , 2017, LSDSem@EACL.

[59]  Daniel Marcu,et al.  An Unsupervised Approach to Recognizing Discourse Relations , 2002, ACL.

[60]  Xuanjing Huang,et al.  Implicit Discourse Relation Detection via a Deep Architecture with Gated Relevance Network , 2016, ACL.

[61]  Yuji Matsumoto,et al.  Jointly Identifying Temporal Relations with Markov Logic , 2009, ACL.

[62]  Cícero Nogueira dos Santos,et al.  Deep Convolutional Neural Networks for Sentiment Analysis of Short Texts , 2014, COLING.