Reinforcement Learning-Based Dialogue Guided Event Extraction to Exploit Argument Relations

Event extraction is a ftask for natural language processing. Finding the roles of event arguments like event participants is essential for event extraction. However, doing so for real-life event descriptions is challenging because an argument’s role often varies in different contexts. While the relationship and interactions between multiple arguments are useful for settling the argument roles, such information is largely ignored by existing approaches. This paper presents a better approach for event extraction by explicitly utilizing the relationships of event arguments. We achieve this through a carefully designed task-oriented dialogue system. To model the argument relation, we employ reinforcement learning and incremental learning to extract multiple arguments via a multi-turned, iterative process. Our approach leverages knowledge of the already extracted arguments of the same sentence to determine the role of arguments that would be difficult to decide individually. It then uses the newly obtained information to improve the decisions of previously extracted arguments. This two-way feedback process allows us to exploit the argument relations to effectively settle argument roles, leading to better sentence understanding and event extraction. Experimental results show that our approach consistently outperforms seven state-of-the-art event extraction methods for the classification of events and argument role and argument identification.

[1]  Mark A. Przybocki,et al.  The Automatic Content Extraction (ACE) Program – Tasks, Data, and Evaluation , 2004, LREC.

[2]  Chitta Baral,et al.  Knowledge Representation, Reasoning and Declarative Problem Solving , 2003 .

[3]  Dongsheng Li,et al.  Exploring Pre-trained Language Models for Event Extraction and Generation , 2019, ACL.

[4]  Enhong Chen,et al.  Budgeted Policy Learning for Task-Oriented Dialogue Systems , 2019, ACL.

[5]  Pawel Budzianowski,et al.  Large-Scale Multi-Domain Belief Tracking with Knowledge Sharing , 2018, ACL.

[6]  Jalel Akaichi,et al.  A Survey of Textual Event Extraction from Social Networks , 2017, LPKM.

[7]  Quan Wang,et al.  Event Extraction as Multi-turn Question Answering , 2020, FINDINGS.

[8]  Zhifang Sui,et al.  Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument Interaction , 2018, AAAI.

[9]  Donghong Ji,et al.  Extracting Entities and Events as a Single Task Using a Transition-Based Neural Model , 2019, IJCAI.

[10]  Yukari Yamakawa,et al.  Event Nugget Annotation: Processes and Issues , 2015, EVENTS@HLP-NAACL.

[11]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[12]  Jun Zhao,et al.  Event Extraction via Dynamic Multi-Pooling Convolutional Neural Networks , 2015, ACL.

[13]  Thien Huu Nguyen,et al.  One for All: Neural Joint Modeling of Entities and Events , 2018, AAAI.

[14]  Philip H. S. Torr,et al.  An embarrassingly simple approach to zero-shot learning , 2015, ICML.

[15]  Claire Cardie,et al.  Event Extraction by Answering (Almost) Natural Questions , 2020, EMNLP.

[16]  Segev Wasserkrug Event Prediction , 2009, Encyclopedia of Database Systems.

[17]  Jun Zhao,et al.  Event Extraction via Bidirectional Long Short-Term Memory Tensor Neural Networks , 2016, CCL.

[18]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[19]  Maria T. Pazienza,et al.  Information Extraction , 2002, Lecture Notes in Computer Science.

[20]  Nanyun Peng,et al.  Biomedical Event Extraction on Graph Edge-conditioned Attention Networks with Hierarchical Knowledge Graphs , 2020, EMNLP.

[21]  Luo Si,et al.  Multi-Turn Dialogue Generation in E-Commerce Platform with the Context of Historical Dialogue , 2020, EMNLP.

[22]  Tsung-Hsien Wen,et al.  Neural Belief Tracker: Data-Driven Dialogue State Tracking , 2016, ACL.

[23]  Boi Faltings,et al.  Meta-Learning for Low-resource Natural Language Generation in Task-oriented Dialogue Systems , 2019, IJCAI.

[24]  Heng Ji,et al.  Liberal Event Extraction and Event Schema Induction , 2016, ACL.

[25]  Jian Liu,et al.  Event Extraction as Machine Reading Comprehension , 2020, EMNLP.

[26]  Jiliang Tang,et al.  A Survey on Dialogue Systems: Recent Advances and New Frontiers , 2017, SKDD.

[27]  Mingxin Zhou,et al.  Entity-Relation Extraction as Multi-Turn Question Answering , 2019, ACL.

[28]  Lifu Huang,et al.  Zero-Shot Transfer Learning for Event Extraction , 2017, ACL.

[29]  Ralph Grishman,et al.  Modeling Skip-Grams for Event Detection with Convolutional Neural Networks , 2016, EMNLP.

[30]  Philipp Koehn,et al.  Abstract Meaning Representation for Sembanking , 2013, LAW@ACL.

[31]  Yue Hu,et al.  History-Adaption Knowledge Incorporation Mechanism for Multi-Turn Dialogue System , 2020, AAAI.

[32]  Weiran Xu,et al.  Joint Event Extraction Based on Skip-Window Convolutional Neural Networks , 2016, NLPCC/ICCPOL.

[33]  Zhoujun Li,et al.  Asking Effective and Diverse Questions: A Machine Reading Comprehension based Framework for Joint Entity-Relation Extraction , 2020, IJCAI.

[34]  Heng Ji,et al.  Joint Entity and Event Extraction with Generative Adversarial Imitation Learning , 2019, Data Intelligence.

[35]  Tom M. Mitchell,et al.  Joint Extraction of Events and Entities within a Document Context , 2016, NAACL.

[36]  Bang Wang,et al.  A Survey of Event Extraction From Text , 2019, IEEE Access.

[37]  Xiao Liu,et al.  Jointly Multiple Events Extraction via Attention-based Graph Information Aggregation , 2018, EMNLP.

[38]  Tao Gui,et al.  A Lexicon-Based Graph Neural Network for Chinese NER , 2019, EMNLP.

[39]  Elizabeth D. Liddy,et al.  Advances in Automatic Text Summarization , 2001, Information Retrieval.

[40]  James Ferguson,et al.  Semi-Supervised Event Extraction with Paraphrase Clusters , 2018, NAACL.

[41]  Dongyan Zhao,et al.  Scale Up Event Extraction Learning via Automatic Training Data Generation , 2017, AAAI.

[42]  Weidong Xiao,et al.  Joint Event Extraction with Hierarchical Policy Network , 2020, COLING.

[43]  Ralph Grishman,et al.  Event Detection and Domain Adaptation with Convolutional Neural Networks , 2015, ACL.