Sentiment Classification of Social Media Content with Features Generated Using Topic Models

This paper presents a method for using topic distributions generated from topic models as features for performing sentiment analysis on documents. This will be tested in the social media domain, specifically Twitter. The proposed approach allows for the mapping from word space to topic space which allows for less fea- tures to be needed and also reduces computational complexity. Multiple machine learning algorithms will be used to test the topic model generated features and a number of different versions of test corpus will be used, including unigrams, bi- grams, part-of-speech tagging and adjectives only. The method proposed will also be compared to other notable topic-sentiment methods such as the aspect-sentiment unification model and the joint sentiment/topic model. The results show that using topic distributions can improve the accuracy of classification algorithms, however, the performance can be dependent on the algorithm used and the initial features used. Additionally, we show that using only topics as features outperforms the hy- brid topic-sentiment models.

[1]  Huan Liu,et al.  Exploiting social relations for sentiment analysis in microblogging , 2013, WSDM.

[2]  Andrew McCallum,et al.  Using Maximum Entropy for Text Classification , 1999 .

[3]  Peter D. Turney Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews , 2002, ACL.

[4]  Yaxin Bi,et al.  A Twofold-LDA Model for Customer Review Analysis , 2011, 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[5]  Carlo Strapparava,et al.  Learning to identify emotions in text , 2008, SAC '08.

[6]  Brian D. Davison,et al.  Empirical study of topic modeling in Twitter , 2010, SOMA '10.

[7]  Adam L. Berger,et al.  A Maximum Entropy Approach to Natural Language Processing , 1996, CL.

[8]  Alice H. Oh,et al.  Aspect and sentiment unification model for online review analysis , 2011, WSDM '11.

[9]  Hongfei Yan,et al.  Jointly Modeling Aspects and Opinions with a MaxEnt-LDA Hybrid , 2010, EMNLP.

[10]  Long Jiang,et al.  User-level sentiment analysis incorporating social networks , 2011, KDD.

[11]  Yulan He,et al.  Joint sentiment/topic model for sentiment analysis , 2009, CIKM.

[12]  Pedro M. Domingos,et al.  On the Optimality of the Simple Bayesian Classifier under Zero-One Loss , 1997, Machine Learning.

[13]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[14]  David D. Lewis,et al.  Naive (Bayes) at Forty: The Independence Assumption in Information Retrieval , 1998, ECML.

[15]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.

[16]  Vaibhavi N Patodkar,et al.  Twitter as a Corpus for Sentiment Analysis and Opinion Mining , 2016 .

[17]  Matthias Baumgarten,et al.  Keyword-Based Sentiment Mining using Twitter , 2013, Int. J. Ambient Comput. Intell..

[18]  Yaxin Bi,et al.  Extended Twofold-LDA Model for Two Aspects in One Sentence , 2012, IPMU.

[19]  Koh Kakusho,et al.  Social Mood Extraction from Twitter Posts with Document Topic Model , 2014, 2014 International Conference on Information Science & Applications (ICISA).

[20]  Andrea Esuli,et al.  SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining , 2010, LREC.

[22]  Michael L. Littman,et al.  Measuring praise and criticism: Inference of semantic orientation from association , 2003, TOIS.

[23]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[24]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..