Fuzzy rule based systems for interpretable sentiment analysis

Sentiment analysis, which is also known as opinion mining, aims to recognise the attitude or emotion of people through natural language processing, text analysis and computational linguistics. In recent years, many studies have focused on sentiment classification in the context of machine learning, e.g. to identify that a sentiment is positive or negative. In particular, the bag-of-words method has been popularly used to transform textual data into structured data, in order to enable the direct use of machine learning algorithms for sentiment classification. Through the bag-of-words method, each single term in a text document is turned into a single attribute to make up a structured data set, which results in high dimensionality of the data set and thus negative impact on the interpretability of computational models for sentiment analysis. This paper proposes the use of fuzzy rule based systems as computational models towards accurate and interpretable analysis of sentiments. The use of fuzzy logic is better aligned with the inherent uncertainty of language, while the “white box” characteristic of the rule based learning approaches leads to better interpretability of the results. The proposed approach is tested on four datasets containing movie reviews; the aim is to compare its performance in terms of accuracy with two other approaches for sentiment analysis that are known to perform very well. The results indicate that the fuzzy rule based approach performs marginally better than the well-known machine learning techniques, while reducing the computational complexity and increasing the interpretability.

[1]  Bo Pang,et al.  A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts , 2004, ACL.

[2]  Bo Pang,et al.  Seeing Stars: Exploiting Class Relationships for Sentiment Categorization with Respect to Rating Scales , 2005, ACL.

[3]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[4]  Han Liu,et al.  Rule Based Systems for Big Data , 2015 .

[5]  T. Ross Fuzzy Logic with Engineering Applications , 1994 .

[6]  Nedyalko Petrov,et al.  Advanced modelling of complex processes by fuzzy networks , 2011 .

[7]  William W. Cohen Fast Effective Rule Induction , 1995, ICML.

[8]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[9]  Timothy J. Ross,et al.  Fuzzy Logic with Engineering Applications: Ross/Fuzzy Logic with Engineering Applications , 2010 .

[10]  Harry Zhang,et al.  A Fast Decision Tree Learning Algorithm , 2006, AAAI.

[11]  Kelly Reynolds,et al.  Using Machine Learning to Detect Cyberbullying , 2011, 2011 10th International Conference on Machine Learning and Applications and Workshops.

[12]  JOHANNES FÜRNKRANZ,et al.  Separate-and-Conquer Rule Learning , 1999, Artificial Intelligence Review.

[13]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[14]  Han Liu,et al.  Interpretability of Computational Models for Sentiment Analysis , 2016, Sentiment Analysis and Ontology Engineering.

[15]  Irina Rish,et al.  An empirical study of the naive Bayes classifier , 2001 .

[16]  Shyi-Ming Chen,et al.  Fuzzy Decision-Making Based on Likelihood-Based Comparison Relations , 2010, IEEE Transactions on Fuzzy Systems.

[17]  Rui Zhao,et al.  Automatic detection of cyberbullying on social networks based on bullying features , 2016, ICDCN.

[18]  Eyke Hüllermeier,et al.  Does machine learning need fuzzy logic? , 2015, Fuzzy Sets Syst..

[19]  Andrew Zisserman,et al.  Efficient Visual Search of Videos Cast as Text Retrieval , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[21]  Shyi-Ming Chen,et al.  A fuzzy reasoning approach for rule-based systems based on fuzzy logics , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[22]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[23]  Lotfi A. Zadeh,et al.  Fuzzy logic - a personal perspective , 2015, Fuzzy Sets Syst..

[24]  Santanu Kumar Rath,et al.  Classification of Sentimental Reviews Using Machine Learning Techniques , 2015 .

[25]  Jadzia Cendrowska,et al.  PRISM: An Algorithm for Inducing Modular Rules , 1987, Int. J. Man Mach. Stud..