Incorporating product description to sentiment topic models for improved aspect-based sentiment analysis

Abstract Sentiment topic models are used as unsupervised methods to solve the specific problems of the general aspect-based sentiment analysis (ABSA) problem. One of the main problems of the technique is its substandard aspect term extraction, which leads to difficulties in aspect label determination. This paper is focused on improving the aspect term extraction of topic models by incorporating product descriptions to the current state-of-the-art sentiment topic model, Aspect Sentiment Unification Model (ASUM). We present two models that extend from ASUM differently to leverage on the information found in the product description: Seller-aided Aspect-based Sentiment Model (SA-ASM) and Seller-aided Product-based Sentiment Model (SA-PSM). SA-ASM has its topic distribution inside the review while SA-PSM has its topic distribution inside the product description. Based on experiments conducted to reviews of laptops and mobile phones, results show that SA-ASM performs better in micro-level problems such as sentiment classification and aspect assignment and SA-PSM performs better in macro-level problems like aspect category detection. Both models achieve better performances compared to current topic modeling methods for the ABSA problem.

[1]  Arjun Mukherjee,et al.  Exploiting Domain Knowledge in Aspect Extraction , 2013, EMNLP.

[2]  H. Kraemer,et al.  Extension of the kappa coefficient. , 1980, Biometrics.

[3]  Michael L. Littman,et al.  Measuring praise and criticism: Inference of semantic orientation from association , 2003, TOIS.

[4]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.

[5]  Bing Liu,et al.  Mining Aspect-Specific Opinion using a Holistic Lifelong Topic Model , 2016, WWW.

[6]  Kiyoaki Shirai,et al.  PhraseRNN: Phrase Recursive Neural Network for Aspect-based Sentiment Analysis , 2015, EMNLP.

[7]  Yue Gao,et al.  Exploring Principles-of-Art Features For Image Emotion Recognition , 2014, ACM Multimedia.

[8]  Li Zhao,et al.  Attention-based LSTM for Aspect-level Sentiment Classification , 2016, EMNLP.

[9]  Yue Gao,et al.  Continuous Probability Distribution Prediction of Image Emotions via Multitask Shared Sparse Regression , 2017, IEEE Transactions on Multimedia.

[10]  Luis Alfonso Ureña López,et al.  Combining resources to improve unsupervised sentiment analysis at aspect-level , 2016, J. Inf. Sci..

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Aitor García Pablos,et al.  V3: Unsupervised Aspect Based Sentiment Analysis for SemEval2015 Task 12 , 2015, *SEMEVAL.

[13]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[14]  Gerard de Melo,et al.  Sentiment-Aspect Extraction based on Restricted Boltzmann Machines , 2015, ACL.

[15]  Xiaokui Xiao,et al.  Recursive Neural Conditional Random Fields for Aspect-based Sentiment Analysis , 2016, EMNLP.

[16]  Suresh Manandhar,et al.  SemEval-2014 Task 4: Aspect Based Sentiment Analysis , 2014, *SEMEVAL.

[17]  Luciano da Fontoura Costa,et al.  Unveiling the relationship between complex networks metrics and word senses , 2012, ArXiv.

[18]  Ekawit Nantajeewarawat,et al.  Exploring linguistic structure for aspect-based sentiment analysis , 2016 .

[19]  Mark Steyvers,et al.  Finding scientific topics , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Yulan He,et al.  Joint sentiment/topic model for sentiment analysis , 2009, CIKM.

[21]  Wei Wang,et al.  Sentiment analysis of online product reviews with Semi-supervised topic sentiment mixture model , 2010, 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery.

[22]  Yoshua Bengio,et al.  Domain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach , 2011, ICML.

[23]  P. Waila,et al.  Sentiment analysis of movie reviews: A new feature-based heuristic for aspect-level sentiment classification , 2013, 2013 International Mutli-Conference on Automation, Computing, Communication, Control and Compressed Sensing (iMac4s).

[24]  Noémie Elhadad,et al.  An Unsupervised Aspect-Sentiment Model for Online Reviews , 2010, NAACL.

[25]  ChengXiang Zhai,et al.  SpecLDA: Modeling Product Reviews and Specifications to Generate Augmented Specifications , 2015, SDM.

[26]  Suresh Manandhar,et al.  SemEval-2015 Task 12: Aspect Based Sentiment Analysis , 2015, *SEMEVAL.

[27]  John G. Breslin,et al.  A Hierarchical Model of Reviews for Aspect-based Sentiment Analysis , 2016, EMNLP.

[28]  Jingbo Zhu,et al.  Aspect-based sentence segmentation for sentiment summarization , 2009, CIKM 2009.

[29]  Ivan Titov,et al.  A Joint Model of Text and Aspect Ratings for Sentiment Summarization , 2008, ACL.

[30]  Mayank Gulaty,et al.  Aspect-Based Sentiment Analysis , 2016 .

[31]  Xu Ling,et al.  Topic sentiment mixture: modeling facets and opinions in weblogs , 2007, WWW '07.

[32]  Alice H. Oh,et al.  Aspect and sentiment unification model for online review analysis , 2011, WSDM '11.

[33]  Md. Mustafizur Rahman,et al.  Hidden Topic Sentiment Model , 2016, WWW.

[34]  Jun Guo,et al.  A holistic model of mining product aspects and associated sentiments from online reviews , 2014, Multimedia Tools and Applications.

[35]  Arjun Mukherjee,et al.  Leveraging Multi-Domain Prior Knowledge in Topic Models , 2013, IJCAI.

[36]  Nigel Collier,et al.  Incorporating topic information into sentiment analysis models , 2004, ACL 2004.

[37]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[38]  Franciska de Jong,et al.  Care more about customers: Unsupervised domain-independent aspect detection for sentiment analysis of customer reviews , 2013, Knowl. Based Syst..

[39]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[40]  Franciska de Jong,et al.  ADM-LDA: An aspect detection model based on topic modelling using the structure of review sentences , 2014, J. Inf. Sci..