A Hierarchical Aspect-Sentiment Model for Online Reviews

To help users quickly understand the major opinions from massive online reviews, it is important to automatically reveal the latent structure of the aspects, sentiment polarities, and the association between them. However, there is little work available to do this effectively. In this paper, we propose a hierarchical aspect sentiment model (HASM) to discover a hierarchical structure of aspect-based sentiments from unlabeled online reviews. In HASM, the whole structure is a tree. Each node itself is a two-level tree, whose root represents an aspect and the children represent the sentiment polarities associated with it. Each aspect or sentiment polarity is modeled as a distribution of words. To automatically extract both the structure and parameters of the tree, we use a Bayesian nonparametric model, recursive Chinese Restaurant Process (rCRP), as the prior and jointly infer the aspect-sentiment tree from the review texts. Experiments on two real datasets show that our model is comparable to two other hierarchical topic models in terms of quantitative measures of topic trees. It is also shown that our model achieves better sentence-level classification accuracy than previously proposed aspect-sentiment joint models.

[1]  Michael I. Jordan,et al.  Tree-Structured Stick Breaking for Hierarchical Data , 2010, NIPS.

[2]  Michael L. Littman,et al.  Measuring praise and criticism: Inference of semantic orientation from association , 2003, TOIS.

[3]  Alistair Kennedy,et al.  SENTIMENT CLASSIFICATION of MOVIE REVIEWS USING CONTEXTUAL VALENCE SHIFTERS , 2006, Comput. Intell..

[4]  Arjun Mukherjee,et al.  Aspect Extraction through Semi-Supervised Modeling , 2012, ACL.

[5]  Noriaki Kawamae,et al.  Hierarchical Approach to Sentiment Analysis , 2012, 2012 IEEE Sixth International Conference on Semantic Computing.

[6]  Nicolas Nicolov,et al.  Targeting Sentiment Expressions through Supervised Ranking of Linguistic Configurations , 2009, ICWSM.

[7]  Yulan He,et al.  Joint sentiment/topic model for sentiment analysis , 2009, CIKM.

[8]  Yubo Chen,et al.  Online Consumer Review: Word-of-Mouth as a New Element of Marketing Communication Mix , 2004, Manag. Sci..

[9]  Janyce Wiebe,et al.  Articles: Recognizing Contextual Polarity: An Exploration of Features for Phrase-Level Sentiment Analysis , 2009, CL.

[10]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[11]  Wei Li,et al.  Pachinko allocation: DAG-structured mixture models of topic correlations , 2006, ICML.

[12]  Ivan Titov,et al.  Modeling online reviews with multi-grain topic models , 2008, WWW.

[13]  Thomas L. Griffiths,et al.  The nested chinese restaurant process and bayesian nonparametric inference of topic hierarchies , 2007, JACM.

[14]  Martin Ester,et al.  Aspect-based opinion mining from product reviews , 2012, SIGIR '12.

[15]  Rohini K. Srihari,et al.  OpinionMiner: a novel machine learning system for web opinion mining and extraction , 2009, KDD.

[16]  Jon Atle Gulla,et al.  Sentiment Learning on Product Reviews via Sentiment Ontology Tree , 2010, ACL.

[17]  Xiaoyan Zhu,et al.  Sentiment Analysis with Global Topics and Local Dependency , 2010, AAAI.

[18]  Alice H. Oh,et al.  Aspect and sentiment unification model for online review analysis , 2011, WSDM '11.

[19]  Bin Shi,et al.  Generating a concept hierarchy for sentiment analysis , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[20]  Stefan M. Rüger,et al.  Weakly Supervised Joint Sentiment-Topic Detection from Text , 2012, IEEE Transactions on Knowledge and Data Engineering.

[21]  Koji Eguchi,et al.  Sentiment Retrieval using Generative Models , 2006, EMNLP.

[22]  Nuria Oliver,et al.  Leveraging user comments for aesthetic aware image search reranking , 2012, WWW.

[23]  Samaneh Moghaddam,et al.  Aspect-based opinion mining in online reviews , 2013 .

[24]  Dongwoo Kim,et al.  Modeling topic hierarchies with the recursive chinese restaurant process , 2012, CIKM.

[25]  Shlomo Argamon,et al.  Extracting Appraisal Expressions , 2007, NAACL.