Jointly Learning Sentiment, Keyword and Opinion Leader in Social Reviews

Social review sites offer a wealth of information beyond sentiment polarity. For instance, on IMDb users leave valuable reviews on different aspects of a movie (e.g. Actors, visual effects). This inspires researchers to fully discover information from social review texts for the sake of modelling users behavior. Previous studies have spent a large amount of effort to identify sentiment scores from reviews. Yet questions like "What are the key plot in this movie?" and "Who is the valuable user I should follow?", the answers of which comprehensively support user decision making process, can not be answered in those works. To jointly learn from sentiment, text and user in social reviews, we draw inspiration that only a small portion of reviewers can generate useful information, and propose a sparse overlapping user lasso model to tackle these challenges. In addition, we show how to efficiently solve the resulting optimization challenges using the alternating directions method of multipliers (ADMM), a framework which divides our objective into sub-tasks that are easy to fulfill. By experimenting several experiments on 3 real world social review datasets, we demonstrate that our method consistently outperforms other state-of-the-art models in sentiment classification tasks, meanwhile generating accurate results on keywords discovering and opinion leader identification task.

[1]  Noah Simon,et al.  A Sparse-Group Lasso , 2013 .

[2]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[3]  Xiaoyan Zhu,et al.  Sentiment Analysis with Global Topics and Local Dependency , 2010, AAAI.

[4]  Alexander J. Smola,et al.  Jointly modeling aspects, ratings and sentiments for movie recommendation (JMARS) , 2014, KDD.

[5]  Julien Mairal,et al.  Optimization with Sparsity-Inducing Penalties , 2011, Found. Trends Mach. Learn..

[6]  E. H. Witte,et al.  Understanding Group Behavior , 2018 .

[7]  R. Tibshirani,et al.  A note on the group lasso and a sparse group lasso , 2010, 1001.0736.

[8]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[9]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[10]  Trevor J. Hastie,et al.  Genome-wide association analysis by lasso penalized logistic regression , 2009, Bioinform..

[11]  Alexander J. Smola,et al.  Parallelized Stochastic Gradient Descent , 2010, NIPS.

[12]  J. Moreau.  Fonctions convexes duales et points proximaux dans un espace hilbertien , 1962 .

[13]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[14]  Qiang Yang,et al.  Cross-domain sentiment classification via spectral feature alignment , 2010, WWW '10.

[15]  Long Jiang,et al.  User-level sentiment analysis incorporating social networks , 2011, KDD.

[16]  Huan Liu,et al.  Exploiting social relations for sentiment analysis in microblogging , 2013, WSDM.

[17]  Lei Zhang,et al.  Sentiment Analysis and Opinion Mining , 2017, Encyclopedia of Machine Learning and Data Mining.

[18]  George Forman,et al.  An Extensive Empirical Study of Feature Selection Metrics for Text Classification , 2003, J. Mach. Learn. Res..

[19]  Andrew Y. Ng,et al.  Parsing Natural Scenes and Natural Language with Recursive Neural Networks , 2011, ICML.

[20]  Yulan He,et al.  Joint sentiment/topic model for sentiment analysis , 2009, CIKM.

[21]  Richard Bellman,et al.  Decision-making in fuzzy environment , 2012 .

[22]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[23]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[24]  Tiejun Zhao,et al.  Target-dependent Twitter Sentiment Classification , 2011, ACL.

[25]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[26]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[27]  Zhaohui Wu,et al.  Collaborative Web Service QoS Prediction with Location-Based Regularization , 2012, 2012 IEEE 19th International Conference on Web Services.

[28]  Eric P. Xing,et al.  Tree-Guided Group Lasso for Multi-Task Regression with Structured Sparsity , 2009, ICML.

[29]  M. J. D. Powell,et al.  A fast algorithm for nonlinearly constrained optimization calculations , 1978 .