Employing hierarchical Bayesian networks in simple and complex emotion topic analysis

Traditional emotion models, when tagging single emotions in documents, often ignore the fact that most documents convey complex human emotions. In this paper, we join emotion analysis with topic models to find complex emotions in documents, as well as the intensity of the emotions, and study how the document emotions vary with topics. Hierarchical Bayesian networks are employed to generate the latent topic variables and emotion variables. On average, our model on single emotion classification outperforms the traditional supervised machine learning models such as SVM and Naive Bayes. The other model on the complex emotion classification also achieves promising results. We thoroughly analyze the impact of vocabulary quality and topic quantity to emotion and intensity prediction in our experiments. The distribution of topics such as Friend and Job are found to be sensitive to the documents' emotions, which we call emotion topic variation in this paper. This reveals the deeper relationship between topics and emotions.

[1]  Plaban Kumar Bhowmick Reader Perspective Emotion Analysis in Text through Ensemble based Multi-Label Classification Framework , 2009, Comput. Inf. Sci..

[2]  P. Ekman Universals and cultural differences in facial expressions of emotion. , 1972 .

[3]  W. Gilks,et al.  Adaptive Rejection Sampling for Gibbs Sampling , 1992 .

[4]  David M. Blei,et al.  Supervised Topic Models , 2007, NIPS.

[5]  Yulan He,et al.  A Comparative Study of Bayesian Models for Unsupervised Sentiment Detection , 2010, CoNLL.

[7]  Grigorios Tsoumakas,et al.  Multi-Label Classification: An Overview , 2007, Int. J. Data Warehous. Min..

[8]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[9]  Fuji Ren,et al.  Bottom up: Exploring word emotions for Chinese sentence chief sentiment classification , 2010, Proceedings of the 6th International Conference on Natural Language Processing and Knowledge Engineering(NLPKE-2010).

[10]  G. Mishne Experiments with Mood Classification in , 2005 .

[11]  Ramesh Nallapati,et al.  Labeled LDA: A supervised topic model for credit attribution in multi-labeled corpora , 2009, EMNLP.

[12]  Carlo Strapparava,et al.  Developing Affective Lexical Resources , 2004, PsychNology J..

[13]  Yulan He,et al.  Joint sentiment/topic model for sentiment analysis , 2009, CIKM.

[14]  Susan T. Dumais,et al.  Partially labeled topic models for interpretable text mining , 2011, KDD.

[15]  Huawen Liu,et al.  Multi-label classification via PCA-PLS , 2015, CSA 2015.

[16]  François-Régis Chaumartin,et al.  UPAR7: A knowledge-based system for headline sentiment tagging , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[17]  Michael I. Jordan,et al.  Loopy Belief Propagation for Approximate Inference: An Empirical Study , 1999, UAI.

[18]  Fuji Ren,et al.  Affective Information Processing and Recognizing Human Emotion , 2006, MFCSIT.

[19]  Eric P. Xing,et al.  A Mixture Model of Demographic Lexical Variation , 2011 .

[20]  Dipankar Das,et al.  Extracting emotion topics from blog sentences: use of voting from multi-engine supervised classifiers , 2010, SMUC '10.

[21]  Kong Joo Lee,et al.  Automatic Affect Recognition Using Natural Language Processing Techniques and Manually Built Affect Lexicon , 2006, IEICE Trans. Inf. Syst..

[22]  Brendan T. O'Connor,et al.  A Latent Variable Model for Geographic Lexical Variation , 2010, EMNLP.

[23]  Changqin Quan,et al.  A blog emotion corpus for emotional expression analysis in Chinese , 2010, Comput. Speech Lang..

[24]  Fuji Ren,et al.  From Cloud Computing to Language Engineering, Affective Computing and Advanced Intelligence ∗ , 2010 .

[25]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[26]  Pero Subasic,et al.  Affect analysis of text using fuzzy semantic typing , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[27]  Kevin P. Murphy,et al.  An introduction to graphical models , 2011 .

[28]  Michael I. Jordan,et al.  A generalized mean field algorithm for variational inference in exponential families , 2002, UAI.

[29]  Mitsuru Ishizuka,et al.  Emotion Estimation and Reasoning Based on Affective Textual Interaction , 2005, ACII.

[30]  S. E. Hills,et al.  Illustration of Bayesian Inference in Normal Data Models Using Gibbs Sampling , 1990 .

[31]  Hsin-Hsi Chen,et al.  Building Emotion Lexicon from Weblog Corpora , 2007, ACL.