Sentiment analysis: a review and comparative analysis over social media

Sentiment analysis is the computational examination of end user’s opinion, attitudes and emotions towards a particular topic or product. Sentiment analysis classifies the message according to their polarity whether it is positive, negative, or neutral. Recently researchers focused on lexical and machine-learning based method for sentiment analysis of social media post. Social media is a micro blogger site in which end users can post their comment in slag language that contains symbols, idioms, misspelled words and sarcastic sentences. Social media data also have curse of dimension problem i.e. high dimension nature of data that required specific pre-processing and feature extraction, which leads to improve classification accuracy. This paper present comprehensive overview of sentiment analysis technique based on recent research and subsequently explores machine learning (SVM, Navies Bayes, Linear Regression and Random Forest) and feature extraction techniques (POS, BOW and HASS tagging) in context of Sentiment analysis over social media data set. Further twitter data-sets are scrutinized and pre-processed with proposed framework,which yield intersecting facts about the capabilities and deficiency of sentiment analysis methods. POS is most suitable feature extraction technique with SVM and Navie Bayes classifier. Whereas Random Forest and linear regression provide the better result with Hass tagging.

[1]  Paul L. Rosin,et al.  Visual Sentiment Prediction Based on Automatic Discovery of Affective Regions , 2018, IEEE Transactions on Multimedia.

[2]  Felipe Bravo-Marquez,et al.  Meta-level sentiment models for big social data analysis , 2014, Knowl. Based Syst..

[3]  Estevam R. Hruschka,et al.  Using unsupervised information to improve semi-supervised tweet sentiment classification , 2016, Inf. Sci..

[4]  Kenji Araki,et al.  Automatically Annotating A Five-Billion-Word Corpus of Japanese Blogs for Affect and Sentiment Analysis , 2012, WASSA@ACL.

[5]  Muazzam Ahmed Siddiqui,et al.  Building an Arabic Sentiment Lexicon Using Semi-supervised Learning , 2014, J. King Saud Univ. Comput. Inf. Sci..

[6]  Hamido Fujita,et al.  A hybrid approach to the sentiment analysis problem at the sentence level , 2016, Knowl. Based Syst..

[7]  Aitor García Pablos,et al.  W2VLDA: Almost unsupervised system for Aspect Based Sentiment Analysis , 2017, Expert Syst. Appl..

[8]  Evgeny A. Stepanov,et al.  Detecting General Opinions from Customer Surveys , 2011, 2011 IEEE 11th International Conference on Data Mining Workshops.

[9]  Wenyin Liu,et al.  Towards building a social emotion detection system for online news , 2014, Future Gener. Comput. Syst..

[10]  Francesco Colace,et al.  Sentiment detection in social networks and in collaborative learning environments , 2015, Comput. Hum. Behav..

[11]  David Zimbra,et al.  Twitter brand sentiment analysis: A hybrid system using n-gram analysis and dynamic artificial neural network , 2013, Expert Syst. Appl..

[12]  Francisco Javier González-Castaño,et al.  Unsupervised method for sentiment analysis in online texts , 2016, Expert Syst. Appl..

[13]  Hongliang Yu,et al.  A study of supervised term weighting scheme for sentiment analysis , 2014, Expert Syst. Appl..

[14]  Nada Lavrac,et al.  Active learning for sentiment analysis on data streams: Methodology and workflow implementation in the ClowdFlows platform , 2015, Inf. Process. Manag..

[15]  Luigi Di Caro,et al.  Sentiment analysis via dependency parsing , 2013, Comput. Stand. Interfaces.

[16]  Ge Yu,et al.  Multimodal learning for topic sentiment analysis in microblogging , 2017, Neurocomputing.

[17]  Roberto V. Zicari,et al.  PoliTwi: Early detection of emerging political topics on twitter and the impact on concept-level sentiment analysis , 2014, Knowl. Based Syst..

[18]  Fermín L. Cruz,et al.  Building layered, multilingual sentiment lexicons at synset and lemma levels , 2014, Expert Syst. Appl..

[19]  Rada Mihalcea,et al.  Computational approaches to subjectivity and sentiment analysis: Present and envisaged methods and applications , 2014, Comput. Speech Lang..

[20]  Jiebo Luo,et al.  Aesthetics and Emotions in Images , 2011, IEEE Signal Processing Magazine.

[21]  Arun Kumar Sangaiah,et al.  Using convolution control block for Chinese sentiment analysis , 2017, J. Parallel Distributed Comput..

[22]  Wu He,et al.  A bilingual approach for conducting Chinese and English social media sentiment analysis , 2014, Comput. Networks.

[23]  Wenge Rong,et al.  Auto-encoder based bagging architecture for sentiment analysis , 2014, J. Vis. Lang. Comput..

[24]  Claire Cardie,et al.  Using natural language processing to improve eRulemaking: project highlight , 2006, DG.O.

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Francisco J. Ballesteros,et al.  AngryEmail? Emotion-Based E-mail Tool Adaptation , 2012, IWAAL.

[27]  Richard Tzong-Han Tsai,et al.  Using relation selection to improve value propagation in a ConceptNet-based sentiment dictionary , 2014, Knowl. Based Syst..

[28]  Estevam R. Hruschka,et al.  Tweet sentiment analysis with classifier ensembles , 2014, Decis. Support Syst..

[29]  Yongtae Park,et al.  Review-based measurement of customer satisfaction in mobile service: Sentiment analysis and VIKOR approach , 2014, Expert Syst. Appl..

[30]  Shunxiang Zhang,et al.  Sentiment analysis of Chinese micro-blog text based on extended sentiment dictionary , 2018, Future Gener. Comput. Syst..

[31]  Luis Alfonso Ureña López,et al.  Sentiment polarity detection in Spanish reviews combining supervised and unsupervised approaches , 2013, Expert Syst. Appl..

[32]  Hua Xu,et al.  Chinese comments sentiment classification based on word2vec and SVMperf , 2015, Expert Syst. Appl..

[33]  Alun D. Preece,et al.  The role of idioms in sentiment analysis , 2015, Expert Syst. Appl..

[34]  Arun Kumar Sangaiah,et al.  Feature-based Compositing Memory Networks for Aspect-based Sentiment Classification in Social Internet of Things , 2017, Future Gener. Comput. Syst..

[35]  Usman Qamar,et al.  eSAP: A decision support framework for enhanced sentiment analysis and polarity classification , 2016, Inf. Sci..

[36]  Kai Hwang,et al.  An invitation to participate in this new journal , 1984, J. Parallel Distributed Comput..

[37]  Yong Shi,et al.  DWWP: Domain-specific new words detection and word propagation system for sentiment analysis in the tourism domain , 2018, Knowl. Based Syst..

[38]  Franciska de Jong,et al.  Care more about customers: Unsupervised domain-independent aspect detection for sentiment analysis of customer reviews , 2013, Knowl. Based Syst..

[39]  Josef Steinberger,et al.  Supervised sentiment analysis in Czech social media , 2014, Inf. Process. Manag..

[40]  Pei-Chann Chang,et al.  Using a contextual entropy model to expand emotion words and their intensity for the sentiment classification of stock market news , 2013, Knowl. Based Syst..

[41]  José Manuel Perea Ortega,et al.  Sentiment analysis system adaptation for multilingual processing: The case of tweets , 2015, Inf. Process. Manag..

[42]  Zhu Zhang,et al.  POS-RS: A Random Subspace method for sentiment classification based on part-of-speech analysis , 2015, Inf. Process. Manag..

[43]  Erik Cambria,et al.  Fusing audio, visual and textual clues for sentiment analysis from multimodal content , 2016, Neurocomputing.

[44]  Feng Zhou,et al.  Augmenting feature model through customer preference mining by hybrid sentiment analysis , 2017, Expert Syst. Appl..

[45]  P. Deepa Shenoy,et al.  A novel sentiment aware dictionary for multi-domain sentiment classification , 2017, Comput. Electr. Eng..

[46]  Usman Qamar,et al.  SentiMI: Introducing point-wise mutual information with SentiWordNet to improve sentiment polarity detection , 2016, Appl. Soft Comput..

[47]  Jiun-Hung Chen,et al.  A multi-label classification based approach for sentiment classification , 2015, Expert Syst. Appl..

[48]  Henry Lieberman,et al.  A model of textual affect sensing using real-world knowledge , 2003, IUI '03.

[49]  Raymond Y. K. Lau,et al.  Social analytics: Learning fuzzy product ontologies for aspect-oriented sentiment analysis , 2014, Decis. Support Syst..

[50]  Alexandra Balahur,et al.  Comparative experiments using supervised learning and machine translation for multilingual sentiment analysis , 2014, Comput. Speech Lang..

[51]  Nick Bassiliades,et al.  Ontology-based sentiment analysis of twitter posts , 2013, Expert Syst. Appl..

[52]  Ronen Feldman,et al.  Techniques and applications for sentiment analysis , 2013, CACM.

[53]  Rainer Schrader,et al.  Sentiment Polarity Classification Using Statistical Data Compression Models , 2012, 2012 IEEE 12th International Conference on Data Mining Workshops.

[54]  Luis Alfonso Ureña López,et al.  Ranked WordNet graph for Sentiment Polarity Classification in Twitter , 2014, Comput. Speech Lang..

[55]  Ying Wah Teh,et al.  Text mining of news-headlines for FOREX market prediction: A Multi-layer Dimension Reduction Algorithm with semantics and sentiment , 2015, Expert Syst. Appl..

[56]  Ahmed Abbasi,et al.  Affect Intensity Analysis of Dark Web Forums , 2007, 2007 IEEE Intelligence and Security Informatics.

[57]  Luis Alfonso Ureña López,et al.  Crowd explicit sentiment analysis , 2014, Knowl. Based Syst..

[58]  Miguel A. Alonso,et al.  Universal, Unsupervised, Uncovered Sentiment Analysis , 2016, ArXiv.

[59]  Ping Liu,et al.  Sentiment Classification Based on AS-LDA Model , 2014, ITQM.

[60]  Nada Lavrac,et al.  Stream-based active learning for sentiment analysis in the financial domain , 2014, Inf. Sci..

[61]  Jong-Seok Lee,et al.  Data-driven integration of multiple sentiment dictionaries for lexicon-based sentiment classification of product reviews , 2014, Knowl. Based Syst..

[62]  Uzay Kaymak,et al.  Multi-lingual support for lexicon-based sentiment analysis guided by semantics , 2014, Decis. Support Syst..

[63]  Yong Shi,et al.  The Role of Text Pre-processing in Sentiment Analysis , 2013, ITQM.

[64]  Yidong Chen,et al.  Sentiment analysis via integrating distributed representations of variable-length word sequence , 2016, Neurocomputing.

[65]  Li Chen,et al.  News impact on stock price return via sentiment analysis , 2014, Knowl. Based Syst..

[66]  Rosa M. Carro,et al.  Sentiment analysis in Facebook and its application to e-learning , 2014, Comput. Hum. Behav..