Twitter sentiment analysis with a deep neural network: An enhanced approach using user behavioral information

Abstract Sentiment analysis on social media such as Twitter has become a very important and challenging task. Due to the characteristics of such data—tweet length, spelling errors, abbreviations, and special characters—the sentiment analysis task in such an environment requires a non-traditional approach. Moreover, social media sentiment analysis is a fundamental problem with many interesting applications. Most current social media sentiment classification methods judge the sentiment polarity primarily according to textual content and neglect other information on these platforms. In this paper, we propose a neural network model that also incorporates user behavioral information within a given document (tweet). The neural network used in this paper is a Convolutional Neural Network (CNN). The system is evaluated on two datasets provided by the SemEval-2016 Workshop. The proposed model outperforms current baseline models (including Naive Bayes and Support Vector Machines), which shows that going beyond the content of a document (tweet) is beneficial in sentiment classification, because it provides the classifier with a deep understanding of the task.

[1]  Vadlamani Ravi,et al.  A survey on opinion mining and sentiment analysis: Tasks, approaches and applications , 2015, Knowl. Based Syst..

[2]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[3]  Shivakant Mishra,et al.  Studying the attributes of users in Twitter considering their emotional states , 2015, Social Network Analysis and Mining.

[4]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[5]  Gary Nichols,et al.  Processes, facies and architecture of fluvial distributary system deposits , 2007 .

[6]  Ming Zhou,et al.  Sentiment Embeddings with Applications to Sentiment Analysis , 2016, IEEE Transactions on Knowledge and Data Engineering.

[7]  Bo Pang,et al.  A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts , 2004, ACL.

[8]  Luis Alfonso Ureña López,et al.  Sentiment analysis in Twitter , 2012, Natural Language Engineering.

[9]  Dipankar Das,et al.  Emotion Analysis on Social Media: Natural Language Processing Approaches and Applications , 2014 .

[10]  Mike Thelwall,et al.  Sentiment in Twitter events , 2011, J. Assoc. Inf. Sci. Technol..

[11]  Xiaojin Zhu,et al.  Seeing stars when there aren’t many stars: Graph-based semi-supervised learning for sentiment categorization , 2006 .

[12]  ThelwallMike,et al.  Twitter, MySpace, Digg , 2012 .

[13]  Richárd Farkas,et al.  A comparative empirical study on social media sentiment analysis over various genres and languages , 2017, Artificial Intelligence Review.

[14]  Bracha Shapira,et al.  ConSent: Context-based sentiment analysis , 2015, Knowl. Based Syst..

[15]  Björn W. Schuller,et al.  New Avenues in Opinion Mining and Sentiment Analysis , 2013, IEEE Intelligent Systems.

[16]  Marie-Francine Moens,et al.  A survey on the application of recurrent neural networks to statistical language modeling , 2015, Comput. Speech Lang..

[17]  Leandro Nunes de Castro,et al.  A multi-label, semi-supervised classification approach applied to personality prediction in social media , 2014, Neural Networks.

[18]  Georgios Paltoglou,et al.  Opinion Retrieval: Searching for Opinions in Social Media , 2014, Professional Search in the Modern World.

[19]  Yiran Chen,et al.  Quantitative Study of Individual Emotional States in Social Networks , 2012, IEEE Transactions on Affective Computing.

[20]  Yaxin Bi,et al.  Improved lexicon-based sentiment analysis for social media analytics , 2015, Security Informatics.

[21]  Diana Maynard,et al.  Automatic Detection of Political Opinions in Tweets , 2011, #MSM.

[22]  De-Shuang Huang,et al.  A constructive approach for finding arbitrary roots of polynomials by neural networks , 2004, IEEE Transactions on Neural Networks.

[23]  Fabio Crestani,et al.  Like It or Not , 2016, ACM Comput. Surv..

[24]  Luigi Benedicenti,et al.  A sentiment analysis prototype system for social network data , 2014, 2014 IEEE 27th Canadian Conference on Electrical and Computer Engineering (CCECE).

[25]  Leandro Nunes de Castro,et al.  Predicting Temperament from Twitter Data , 2016, 2016 5th IIAI International Congress on Advanced Applied Informatics (IIAI-AAI).

[26]  Zhendong Niu,et al.  Automatic construction of domain-specific sentiment lexicon based on constrained label propagation , 2014, Knowl. Based Syst..

[27]  Mike Thelwall,et al.  Twitter, MySpace, Digg: Unsupervised Sentiment Analysis in Social Media , 2012, TIST.

[28]  N. Agarwal,et al.  Online Collective Action , 2014, Lecture Notes in Social Networks.

[29]  Zhenyu Yang,et al.  Sentiment analysis on tweets for social events , 2013, Proceedings of the 2013 IEEE 17th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[30]  Tiejun Zhao,et al.  Target-dependent Twitter Sentiment Classification , 2011, ACL.

[31]  Fabrício Benevenuto,et al.  Comparing and combining sentiment analysis methods , 2013, COSN '13.

[32]  Mike Thelwall,et al.  Sentiment in short strength detection informal text , 2010 .

[33]  Usman Qamar,et al.  SentiMI: Introducing point-wise mutual information with SentiWordNet to improve sentiment polarity detection , 2016, Appl. Soft Comput..

[34]  Nirmalie Wiratunga,et al.  A Hybrid Sentiment Lexicon for Social Media Mining , 2014, 2014 IEEE 26th International Conference on Tools with Artificial Intelligence.

[35]  Kang Liu,et al.  Book Review: Sentiment Analysis: Mining Opinions, Sentiments, and Emotions by Bing Liu , 2015, CL.

[36]  Soon Ae Chun,et al.  Twitter sentiment classification for measuring public health concerns , 2015, Social Network Analysis and Mining.