Successes and challenges in developing a hybrid approach to sentiment analysis

This article covers some success and learning experiences attained during the developing of a hybrid approach to Sentiment Analysis (SA) based on a Sentiment Lexicon, Semantic Rules, Negation Handling, Ambiguity Management and Linguistic Variables. The proposed hybrid method is presented and applied to two selected datasets: Movie Review and Sentiment Twitter datasets. The achieved results are compared against those obtained when Naïve Bayes (NB) and Maximum Entropy (ME) supervised machine learning classification methods are used for the same datasets. The proposed hybrid system attained higher accuracy and precision scores than NB and ME, which shows its superiority when applied to the SA problem at the sentence level. Finally, an alternative strategy to calculating the orientation polarity and polarity intensity in one step instead of the two steps method used in the hybrid approach is explored. The analysis of the yielded mixed results achieved with this alternative approach shows its potential as an aid in the computation of semantic orientations and produced some lessons learnt in developing a more effective mechanism to calculating the orientation polarity and polarity intensity.

[1]  Lei Zhang,et al.  Sentiment Analysis and Opinion Mining , 2017, Encyclopedia of Machine Learning and Data Mining.

[2]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[3]  Klaus Winkelmann Conference on Innovative Applications of Artificial Intelligence , 1989, Künstliche Intell..

[4]  Vasileios Hatzivassiloglou,et al.  Towards the Automatic Identification of Adjectival Scales: Clustering Adjectives According to Meaning , 1993, ACL.

[5]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[6]  Francisco Herrera,et al.  Cardinal Consistency of Reciprocal Preference Relations: A Characterization of Multiplicative Transitivity , 2009, IEEE Transactions on Fuzzy Systems.

[7]  Francisco Chiclana,et al.  Linguistic majorities with difference in support , 2014, Appl. Soft Comput..

[8]  Philipp Koehn,et al.  Synthesis Lectures on Human Language Technologies , 2016 .

[9]  Lotfi A. Zadeh,et al.  A New Direction in AI: Toward a Computational Theory of Perceptions , 2001, AI Mag..

[10]  M. de Rijke,et al.  UvA-DARE ( Digital Academic Repository ) Using WordNet to measure semantic orientations of adjectives , 2004 .

[11]  Bernadette Bouchon-Meunier,et al.  Expressions of graduality for sentiments analysis — A survey , 2010, International Conference on Fuzzy Systems.

[12]  Mike Y. Chen,et al.  Yahoo! for Amazon: Sentiment Extraction from Small Talk on the Web , 2001 .

[13]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[14]  János Fodor,et al.  On Rational Uninorms , 2000 .

[15]  Francisco Chiclana,et al.  Main Concepts, State of the Art and Future Research Questions in Sentiment Analysis. , 2015 .

[16]  Lotfi A. Zadeh,et al.  From Computing with Numbers to Computing with Words - from Manipulation of Measurements to Manipulation of Perceptions , 2005, Logic, Thought and Action.

[17]  Radko Mesiar,et al.  On the Relationship of Associative Compensatory operators to triangular Norms and Conorms , 1996, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[18]  Vincenzo Loia,et al.  A fuzzy-oriented sentic analysis to capture the human emotion in Web-based content , 2014, Knowl. Based Syst..

[19]  Pero Subasic,et al.  Affect analysis of text using fuzzy semantic typing , 2001, IEEE Trans. Fuzzy Syst..

[20]  Imre J. Rudas,et al.  Information Aggregation in Intelligent Systems Using Generalized Operators , 2006, Int. J. Comput. Commun. Control.

[21]  Kathleen R. McKeown,et al.  Predicting the semantic orientation of adjectives , 1997 .

[22]  Christopher D. Manning,et al.  Baselines and Bigrams: Simple, Good Sentiment and Topic Classification , 2012, ACL.

[23]  Janyce Wiebe,et al.  Learning Subjective Adjectives from Corpora , 2000, AAAI/IAAI.

[24]  Bo Pang,et al.  Seeing Stars: Exploiting Class Relationships for Sentiment Categorization with Respect to Rating Scales , 2005, ACL.

[25]  Bruce G. Buchanan,et al.  The MYCIN Experiments of the Stanford Heuristic Programming Project , 1985 .

[26]  Ronald R. Yager,et al.  Uninorm aggregation operators , 1996, Fuzzy Sets Syst..

[27]  Alok N. Choudhary,et al.  MuSES: Multilingual Sentiment Elicitation System for Social Media Data , 2014, IEEE Intelligent Systems.

[28]  Navneet Kaur,et al.  Opinion mining and sentiment analysis , 2016, 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom).

[29]  A. M. H. Elyasir,et al.  Evolution of Opinion Mining , 2013 .

[30]  Mike Y. Chen,et al.  Yahoo! For Amazon: Sentiment Parsing from Small Talk on the Web , 2001 .

[31]  Masrah Azrifah Azmi Murad,et al.  Sentiment classification of customer reviews based on fuzzy logic , 2010, 2010 International Symposium on Information Technology.

[32]  Vincenzo Loia,et al.  Capturing Digest Emotions by Means of Fuzzy Linguistic Aggregation , 2016, Sentiment Analysis and Ontology Engineering.

[33]  Andrea Esuli,et al.  SENTIWORDNET: A Publicly Available Lexical Resource for Opinion Mining , 2006, LREC.