Public Sentiment Drift Analysis Based on Hierarchical Variational Auto-encoder

Detecting public sentiment drift is a challenging task due to sentiment change over time. Existing methods first build a classification model using historical data and subsequently detect drift if the model performs much worse on new data. In this paper, we focus on distribution learning by proposing a novel Hierarchical Variational Auto-Encoder (HVAE) model to learn better distribution representation, and design a new drift measure to directly evaluate distribution changes between historical data and new data.Our experimental results demonstrate that our proposed model achieves better results than three existing state-of-the-art methods.

[1]  Girijesh Prasad,et al.  EWMA model based shift-detection methods for detecting covariate shifts in non-stationary environments , 2015, Pattern Recognit..

[2]  Zhao Lu,et al.  Discovering Opinion Changes in Online Reviews via Learning Fine-Grained Sentiments , 2016, 2016 IEEE 2nd International Conference on Collaboration and Internet Computing (CIC).

[3]  João Gama,et al.  Learning with Drift Detection , 2004, SBIA.

[4]  Yong Qi,et al.  Information Processing and Management , 1984 .

[5]  Liu Liu,et al.  The Improved EWMA Chart for Heteroscedasticity Process , 2018 .

[6]  Dimitris K. Tasoulis,et al.  Exponentially weighted moving average charts for detecting concept drift , 2012, Pattern Recognit. Lett..

[7]  Ting Wang,et al.  Semi-supervised Aspect-level Sentiment Classification Model based on Variational Autoencoder , 2019, Knowl. Based Syst..

[8]  Yiming Yang,et al.  An Adversarial Approach to High-Quality, Sentiment-Controlled Neural Dialogue Generation , 2019, ArXiv.

[9]  Themis Palpanas,et al.  Managing Diverse Sentiments at Large Scale , 2016, IEEE Transactions on Knowledge and Data Engineering.

[10]  Eirini Ntoutsi,et al.  Sentiment Classification over Opinionated Data Streams Through Informed Model Adaptation , 2017, TPDL.

[11]  Daling Wang,et al.  Detecting Opinion Drift from Chinese Web Comments Based on Sentiment Distribution Computing , 2013, WISE.

[12]  Abdelhamid Bouchachia,et al.  Fuzzy classification in dynamic environments , 2011, Soft Comput..

[13]  Xiaoli Li,et al.  Cooperative Hybrid Semi-Supervised Learning for Text Sentiment Classification , 2019, Symmetry.

[14]  Stefano Ermon,et al.  Bias and Generalization in Deep Generative Models: An Empirical Study , 2018, NeurIPS.

[15]  Ricard Gavaldà,et al.  Learning from Time-Changing Data with Adaptive Windowing , 2007, SDM.

[16]  Juan-Zi Li,et al.  What Happens Next? Future Subevent Prediction Using Contextual Hierarchical LSTM , 2017, AAAI.

[17]  Chuhan Wu,et al.  Semi-supervised dimensional sentiment analysis with variational autoencoder , 2019, Knowl. Based Syst..

[18]  Tai Hoang,et al.  Towards Autoencoding Variational Inference for Aspect-Based Opinion Summary , 2019, Appl. Artif. Intell..

[19]  Alan Wee-Chung Liew,et al.  Variational inference based bayes online classifiers with concept drift adaptation , 2018, Pattern Recognit..