Sampling latent emotions and topics in a hierarchical Bayesian network

Text emotion analysis suffers from the lack of faithful emotion features, and the difficulty of mining multiple emotions that are mixed together. In this paper, we provide a Gibbs sampling method to solve these two problems. We explicitly characterize the emotion combination phenomenons, and predict the complex emotions of words together with the emotion intensities for each singular emotion through raw texts. Both emotions and emotion intensities are embedded as latent random variables in a hierarchical Bayesian network, while only the words and some preliminary expectations are represented as observed variables. The model which we call word emotion topic (WET) model, also depicts the distribution of word emotions among different topics, which helps to study the variation of word topics and word emotions. Experiment shows promising results of word emotion prediction, which outperforms traditional parsing methods such as Hidden Markov Model and Conditional Random Fields on raw text. The result also presents interesting emotion-topic variations through blog articles.

[1]  Carlo Strapparava,et al.  Developing Affective Lexical Resources , 2004, PsychNology J..

[2]  Pero Subasic,et al.  Affect analysis of text using fuzzy semantic typing , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[3]  Mitsuru Ishizuka,et al.  Emotion Estimation and Reasoning Based on Affective Textual Interaction , 2005, ACII.

[4]  Shingo Kuroiwa,et al.  A Model of Mental State Transition Network , 2007 .

[5]  Peter D. Turney,et al.  Emotions Evoked by Common Words and Phrases: Using Mechanical Turk to Create an Emotion Lexicon , 2010, HLT-NAACL 2010.

[6]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Nir Friedman,et al.  Probabilistic Graphical Models , 2009, Data-Driven Computational Neuroscience.

[8]  Fuji Ren,et al.  Bottom up: Exploring word emotions for Chinese sentence chief sentiment classification , 2010, Proceedings of the 6th International Conference on Natural Language Processing and Knowledge Engineering(NLPKE-2010).

[9]  Kenji Kita,et al.  Exploring Emotional Words for Chinese Document Chief Emotion Analysis , 2011, PACLIC.

[10]  Vincent Ng,et al.  Examining the Role of Linguistic Knowledge Sources in the Automatic Identification and Classification of Reviews , 2006, ACL.

[11]  Fuji Ren,et al.  Advanced Information Retrieval , 2006, MFCSIT.

[12]  Fuji Ren,et al.  Human emotion model based on discourse sentence for expression generation of conversation agent , 2008, 2008 International Conference on Natural Language Processing and Knowledge Engineering.

[13]  Hsin-Hsi Chen,et al.  Building Emotion Lexicon from Weblog Corpora , 2007, ACL.

[14]  Kong Joo Lee,et al.  Automatic Affect Recognition Using Natural Language Processing Techniques and Manually Built Affect Lexicon , 2006, IEICE Trans. Inf. Syst..

[15]  Changqin Quan,et al.  A blog emotion corpus for emotional expression analysis in Chinese , 2010, Comput. Speech Lang..

[16]  Carlo Strapparava,et al.  Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text , 2010 .

[17]  Fuji Ren,et al.  Affective Information Processing and Recognizing Human Emotion , 2006, MFCSIT.

[18]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[19]  Dipankar Das,et al.  Word to Sentence Level Emotion Tagging for Bengali Blogs , 2009, ACL/IJCNLP.