Event prediction based on evolutionary event ontology knowledge

Abstract The evolution and development of breaking news events usually present regular patterns, leading to the happening of sequential events. Therefore, the analysis of such evolutionary patterns among events and prediction to breaking news events from free text is a valuable capability for decision support systems. Traditional systems tend to focus on contents distribution information but ignore the inherent regularity of evolutionary events. We introduce evolutionary event ontology knowledge (EEOK) structuring the evolutionary patterns in five different event domains, namely Explosion, Conflagration, Geological Hazard, Traffic Accident, Personal Injury. Based on EEOK which provides a representing general-purpose ontology knowledge, we also explore a framework with a pipeline semantic analysis procedure of event extraction, evolutionary event recognization, and event prediction. Since the evolutionary event under each event domain has different evolution patterns, our proposed event prediction model combines the event types to capture the inherent regulation of evolutionary events. Comparative analyses are presented to show the effectiveness of the proposed prediction model compared to other alternative methods.

[1]  Kira Radinsky,et al.  Learning causality for news events prediction , 2012, WWW.

[2]  Jong-Hoon Oh,et al.  Generating Event Causality Hypotheses through Semantic Relations , 2015, AAAI.

[3]  Philip S. Yu,et al.  Fine-grained Event Categorization with Heterogeneous Graph Convolutional Networks , 2019, IJCAI.

[4]  Xiong Li,et al.  Event detection and evolution in multi-lingual social streams , 2020, Frontiers of Computer Science.

[5]  Yue Zhang,et al.  Integrating Order Information and Event Relation for Script Event Prediction , 2017, EMNLP.

[6]  Tim Berners-Lee,et al.  Linked Data - The Story So Far , 2009, Int. J. Semantic Web Inf. Syst..

[7]  Hugo Liu,et al.  ConceptNet — A Practical Commonsense Reasoning Tool-Kit , 2004 .

[8]  ChengXiang Zhai,et al.  Constructing and Embedding Abstract Event Causality Networks from Text Snippets , 2017, WSDM.

[9]  Marie-Francine Moens,et al.  Skip N-grams and Ranking Functions for Predicting Script Events , 2012, EACL.

[10]  Gianluca Demartini,et al.  Predicting the Future Impact of News Events , 2012, ECIR.

[11]  Dan Goldwasser,et al.  Multi-Relational Script Learning for Discourse Relations , 2019, ACL.

[12]  Ting Liu,et al.  Aspect Level Sentiment Classification with Deep Memory Network , 2016, EMNLP.

[13]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[14]  Silvia Rossi,et al.  Predicting the Spatial Impact of Planned Special Events , 2019, W2GIS.

[15]  D. Bobrow,et al.  Representation and Understanding: Studies in Cognitive Science , 1975 .

[16]  Christof Monz,et al.  Recurrent Memory Networks for Language Modeling , 2016, NAACL.

[17]  Jian Zhang,et al.  SQuAD: 100,000+ Questions for Machine Comprehension of Text , 2016, EMNLP.

[18]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[19]  Xiaoming Zhang,et al.  Computing Urban Traffic Congestions by Incorporating Sparse GPS Probe Data and Social Media Data , 2017, ACM Trans. Inf. Syst..

[20]  Raymond J. Mooney,et al.  Learning Statistical Scripts with LSTM Recurrent Neural Networks , 2016, AAAI.

[21]  Raymond J. Mooney,et al.  Statistical Script Learning with Multi-Argument Events , 2014, EACL.

[22]  Ashutosh Modi,et al.  Event Embeddings for Semantic Script Modeling , 2016, CoNLL.

[23]  Zhiyuan Liu,et al.  Learning Entity and Relation Embeddings for Knowledge Graph Completion , 2015, AAAI.

[24]  Junhu Wang,et al.  Event Prediction Based on Causality Reasoning , 2019, ACIIDS.

[25]  Naonori Ueda,et al.  Deep Mixture Point Processes: Spatio-temporal Event Prediction with Rich Contextual Information , 2019, KDD.

[26]  Shen Li,et al.  Revisiting Correlations between Intrinsic and Extrinsic Evaluations of Word Embeddings , 2018, CCL.

[27]  Ralph Grishman,et al.  Joint Event Extraction via Recurrent Neural Networks , 2016, NAACL.

[28]  Ting Liu,et al.  Constructing Narrative Event Evolutionary Graph for Script Event Prediction , 2018, IJCAI.

[29]  Percy Liang,et al.  Know What You Don’t Know: Unanswerable Questions for SQuAD , 2018, ACL.

[30]  Yvon Kermarrec,et al.  Incremental Learning with Social Media Data to Predict Near Real-Time Events , 2014, Discovery Science.

[31]  Lewis Mitchell,et al.  Event Detection in Twitter: A Keyword Volume Approach , 2018, 2018 IEEE International Conference on Data Mining Workshops (ICDMW).

[32]  Chengqi Zhang,et al.  Learning Graph Embedding With Adversarial Training Methods , 2019, IEEE Transactions on Cybernetics.

[33]  Jiannong Cao,et al.  TrafficGAN: Network-Scale Deep Traffic Prediction With Generative Adversarial Nets , 2019, IEEE Transactions on Intelligent Transportation Systems.

[34]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[35]  Yutaka Kidawara,et al.  Toward Future Scenario Generation: Extracting Event Causality Exploiting Semantic Relation, Context, and Association Features , 2014, ACL.

[36]  Zi Huang,et al.  Event Early Embedding: Predicting Event Volume Dynamics at Early Stage , 2017, SIGIR.

[37]  Naren Ramakrishnan,et al.  Tracking Multiple Social Media for Stock Market Event Prediction , 2017, ICDM.

[38]  Wanxiang Che,et al.  LTP: A Chinese Language Technology Platform , 2010, COLING.

[39]  Alina Ristea,et al.  Integration of Social Media in Spatial Crime Analysis and Prediction Models for Events , 2017, AGILE PhD School.

[40]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[41]  Philip S. Yu,et al.  Improving stock market prediction via heterogeneous information fusion , 2017, Knowl. Based Syst..

[42]  Pete Burnap,et al.  Prediction of Malware Propagation and Links within Communities in Social Media Based Events , 2015, WebSci.

[43]  Nathanael Chambers,et al.  Unsupervised Learning of Narrative Event Chains , 2008, ACL.

[44]  Li Zhao,et al.  Attention-based LSTM for Aspect-level Sentiment Classification , 2016, EMNLP.

[45]  Stephen Clark,et al.  What Happens Next? Event Prediction Using a Compositional Neural Network Model , 2016, AAAI.

[46]  Jesse Davis,et al.  Predicting Soccer Highlights from Spatio-Temporal Match Event Streams , 2017, AAAI.

[47]  Francisco C. Pereira,et al.  Combining time-series and textual data for taxi demand prediction in event areas: a deep learning approach , 2018, Inf. Fusion.

[48]  Xiangnan He,et al.  Modeling Extreme Events in Time Series Prediction , 2019, KDD.

[49]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[50]  Salem Chakhar,et al.  A Rough Set Approach to Events Prediction in Multiple Time Series , 2018, IEA/AIE.

[51]  Volker Tresp,et al.  Predicting the co-evolution of event and Knowledge Graphs , 2015, 2016 19th International Conference on Information Fusion (FUSION).

[52]  Detlef D. Nauck,et al.  Sequential Clustering for Event Sequences and Its Impact on Next Process Step Prediction , 2014, IPMU.

[53]  Philip S. Yu,et al.  A Survey on Knowledge Graphs: Representation, Acquisition, and Applications , 2020, IEEE Transactions on Neural Networks and Learning Systems.