A Sequential Model for Classifying Temporal Relations between Intra-Sentence Events

We present a sequential model for temporal relation classification between intra-sentence events. The key observation is that the overall syntactic structure and compositional meanings of the multi-word context between events are important for distinguishing among fine-grained temporal relations. Specifically, our approach first extracts a sequence of context words that indicates the temporal relation between two events, which well align with the dependency path between two event mentions. The context word sequence, together with a parts-of-speech tag sequence and a dependency relation sequence that are generated corresponding to the word sequence, are then provided as input to bidirectional recurrent neural network (LSTM) models. The neural nets learn compositional syntactic and semantic representations of contexts surrounding the two events and predict the temporal relation between them. Evaluation of the proposed approach on TimeBank corpus shows that sequential modeling is capable of accurately recognizing temporal relations between events, which outperforms a neural net model using various discrete features as input that imitates previous feature based models.

[1]  Danqi Chen,et al.  A Fast and Accurate Dependency Parser using Neural Networks , 2014, EMNLP.

[2]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[3]  Will Monroe,et al.  Dependency Parsing Features for Semantic Parsing , 2014 .

[4]  Shan Wang,et al.  Classifying Temporal Relations Between Events , 2007, ACL.

[5]  James Pustejovsky,et al.  SemEval-2007 Task 15: TempEval Temporal Relation Identification , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[6]  Paramita Mirza,et al.  Classifying Temporal Relations with Simple Features , 2014, EACL.

[7]  Vincent Ng,et al.  Classifying Temporal Relations with Rich Linguistic Knowledge , 2013, NAACL.

[8]  Marie-Francine Moens,et al.  Extracting Narrative Timelines as Temporal Dependency Structures , 2012, ACL.

[9]  James H. Martin,et al.  CU-TMP: Temporal Relation Classification Using Syntactic and Semantic Features , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[10]  Jian Su,et al.  Exploiting Discourse Analysis for Article-Wide Temporal Classification , 2013, EMNLP.

[11]  Nate Chambers NavyTime: Event and Time Ordering from Raw Text , 2013, SemEval@NAACL-HLT.

[12]  James Pustejovsky,et al.  Machine Learning of Temporal Relations , 2006, ACL.

[13]  Tommaso Caselli,et al.  SemEval-2010 Task 13: TempEval-2 , 2010, *SEMEVAL.

[14]  Leon Derczynski,et al.  Using Signals to Improve Automatic Classification of Temporal Relations , 2012, ArXiv.

[15]  Eliyahu Kiperwasser,et al.  Simple and Accurate Dependency Parsing Using Bidirectional LSTM Feature Representations , 2016, TACL.

[16]  James Pustejovsky,et al.  TempEval-3: Evaluating Events, Time Expressions, and Temporal Relations , 2012, ArXiv.

[17]  Mark Steedman,et al.  Transforming Dependency Structures to Logical Forms for Semantic Parsing , 2016, TACL.

[18]  Christopher D. Manning,et al.  Stanford typed dependencies manual , 2010 .

[19]  Patrick Pantel,et al.  VerbOcean: Mining the Web for Fine-Grained Semantic Verb Relations , 2004, EMNLP.

[20]  James Pustejovsky,et al.  SemEval-2013 Task 1: TempEval-3: Evaluating Time Expressions, Events, and Temporal Relations , 2013, *SEMEVAL.

[21]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[22]  Yuji Matsumoto,et al.  NAIST.Japan: Temporal Relation Identification Using Dependency Parsed Tree , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[23]  Steven Bethard,et al.  ClearTK-TimeML: A minimalist approach to TempEval 2013 , 2013, *SEMEVAL.

[24]  Takashi Chikayama,et al.  UTTime: Temporal Relation Classification using Deep Syntactic Features , 2013, *SEMEVAL.