Deep rolling: A novel emotion prediction model for a multi-participant communication context

Abstract Nowadays, the amount of user-generated contents (UGCs) or texts has surged exponentially. Therefore, recognizing emotions from these texts can bring about lots of advantages. In this paper, we have proposed a novel model named Deep Rolling to predict emotion for target participant in a multi-participant communication context. First, the proposed method converts a text collection into a set of n-dimension vectors for emotion representation and re-organizes texts into a sequence in time order. Then, Deep Rolling can predict the emotion of target participant corresponding to a future time point. Second, apart from simply taking in texts posted by target participant via LSTM, the proposed method has also incorporated texts posted by other participants at every time step by CNN. In this way, Deep Rolling can predict target participant’s emotion by processing emotions from both the target and all the other participants in an ensemble way. Finally, data factorization has also been introduced into Deep Rolling to enhance the overall prediction efficiency. According to experimental results, compared with the state-of-art methods, our proposed model has achieved the best prediction precision on different target participants. At the same time, Deep Rolling has also maintained the prediction efficiency at an acceptable level.

[1]  Tinghuai Ma,et al.  An efficient and scalable density-based clustering algorithm for datasets with complex structures , 2016, Neurocomputing.

[2]  Soumadip Ghosh,et al.  Sentiment Analysis in the Light of LSTM Recurrent Neural Networks , 2018, Int. J. Synth. Emot..

[3]  Wei-Po Lee,et al.  Tracking and recognizing emotions in short text messages from online chatting services , 2018, Inf. Process. Manag..

[4]  Yunqian Ma,et al.  Practical selection of SVM parameters and noise estimation for SVM regression , 2004, Neural Networks.

[5]  Naixue Xiong,et al.  Using Multi-Modal Semantic Association Rules to fuse keywords and visual features automatically for Web image retrieval , 2011, Inf. Fusion.

[6]  Vasilii A. Gromov,et al.  Predictive clustering on non-successive observations for multi-step ahead chaotic time series prediction , 2015, Neural Computing and Applications.

[7]  W. Mook,et al.  Core fragments in Chernobyl fallout , 1986, Nature.

[8]  Stephan Narison,et al.  The τ→ντηπ process in and beyond QCD , 1987 .

[9]  Minh-Tien Nguyen,et al.  Social context summarization using user-generated content and third-party sources , 2017, Knowl. Based Syst..

[10]  Guangzhong Dong,et al.  A Method for Peak Power Prediction of Series-Connected Lithium-ion Battery Pack Using Extended Kalman Filter , 2017 .

[11]  Xi Liu,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < , 2022 .

[12]  Pramod K. Varshney,et al.  Decision tree regression for soft classification of remote sensing data , 2005 .

[13]  Johan A. K. Suykens,et al.  Support Vector Machine Classifier With Pinball Loss , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Ana Colubi,et al.  A linear regression model for imprecise response , 2010, Int. J. Approx. Reason..

[15]  Zhenhong Du,et al.  Red tide time series forecasting by combining ARIMA and deep belief network , 2017, Knowl. Based Syst..

[16]  Jian Sun,et al.  Object Detection Networks on Convolutional Feature Maps , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Kyeongsu Kim,et al.  NARX modeling for real-time optimization of air and gas compression systems in chemical processes , 2018, Comput. Chem. Eng..

[18]  Zornitsa Kozareva,et al.  UA-ZBSA: A Headline Emotion Classification through Web Information , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[19]  Rong Yan,et al.  Mining Social Emotions from Affective Text , 2012, IEEE Transactions on Knowledge and Data Engineering.

[20]  F. Chang,et al.  Integrating hydrometeorological information for rainfall‐runoff modelling by artificial neural networks , 2009 .

[21]  Chao Li,et al.  A topic BiLSTM model for sentiment classification , 2018, ICIAI '18.

[22]  Martín Abadi,et al.  TensorFlow: learning functions at scale , 2016, ICFP.

[23]  Wei Hao,et al.  Cycle-Length Prediction in Actuated Traffic-Signal Control Using ARIMA Model , 2018, J. Comput. Civ. Eng..

[24]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[25]  Mei-rong Zhao,et al.  An evolutionary deep neural network for predicting morbidity of gastrointestinal infections by food contamination , 2017, Neurocomputing.

[26]  Shourya Roy,et al.  Fine-Grained Emotion Detection in Contact Center Chat Utterances , 2017, PAKDD.

[27]  Vivek Srikumar,et al.  Predicting electricity consumption for commercial and residential buildings using deep recurrent neural networks , 2018 .

[28]  Luc Devroye,et al.  On the layered nearest neighbour estimate, the bagged nearest neighbour estimate and the random forest method in regression and classification , 2010, J. Multivar. Anal..

[29]  Tong Zhang,et al.  Spatial–Temporal Recurrent Neural Network for Emotion Recognition , 2017, IEEE Transactions on Cybernetics.

[30]  Aubrey Poon,et al.  The transmission mechanism of Malaysian monetary policy: a time-varying vector autoregression approach , 2018 .

[31]  Mehmet Balcilar,et al.  Testing the Asymmetric Effects of Financial Conditions in South Africa: A Nonlinear Vector Autoregression Approach , 2016 .

[32]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[33]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[34]  Kang Liu,et al.  Book Review: Sentiment Analysis: Mining Opinions, Sentiments, and Emotions by Bing Liu , 2015, CL.

[35]  Garrison W. Cottrell,et al.  Substructure Vibration NARX Neural Network Approach for Statistical Damage Inference , 2013 .

[36]  Janez Demšar,et al.  Emotion Recognition on Twitter: Comparative Study and Training a Unison Model , 2020, IEEE Transactions on Affective Computing.

[37]  Sreekanth Madisetty,et al.  An Ensemble Based Method for Predicting Emotion Intensity of Tweets , 2017, MIKE.

[38]  Sun-Yuan Kung,et al.  A delay damage model selection algorithm for NARX neural networks , 1997, IEEE Trans. Signal Process..

[39]  Ying Zhang,et al.  Online News Emotion Prediction with Bidirectional LSTM , 2016, WAIM.

[40]  Yao Wang,et al.  LED: A fast overlapping communities detection algorithm based on structural clustering , 2016, Neurocomputing.

[41]  Limin Wang,et al.  Knowledge Guided Disambiguation for Large-Scale Scene Classification With Multi-Resolution CNNs , 2016, IEEE Transactions on Image Processing.

[42]  Cecilia Ovesdotter Alm,et al.  Emotions from Text: Machine Learning for Text-based Emotion Prediction , 2005, HLT.