Machine Learning Approach for Sentiment Analysis

Machine learning algorithms have been widely used for sentiment analysis [66]. The bag-of-words (BoW) representation is commonly used for sentiment analysis [63, 93]. BoW method assumes the independence of words and ignores the importance of semantic and subjective information in the text. All the words in the text are considered equally important. The BoW representation is commonly used for sentiment analysis, resulting into high dimensionality of the feature space. Machine learning algorithms reduce this high-dimensional feature space with the help of feature selection techniques which selects only important features by eliminating the noisy and irrelevant features. Recently, machine learning-based sentiment analysis models are gaining prominence in the field [66].

[1]  Lawrence D. Fu,et al.  A comprehensive empirical comparison of modern supervised classification and feature selection methods for text categorization , 2014, J. Assoc. Inf. Sci. Technol..

[2]  Alexander F. Gelbukh,et al.  Dependency-Based Semantic Parsing for Concept-Level Text Analysis , 2014, CICLing.

[3]  Jin-Cheon Na,et al.  Sentence-Level Sentiment Polarity Classification Using a Linguistic Approach , 2011, ICADL.

[4]  Rudy Prabowo,et al.  Sentiment analysis: A combined approach , 2009, J. Informetrics.

[5]  Dai Quoc Nguyen,et al.  A Two-Stage Classifier for Sentiment Analysis , 2013, IJCNLP.

[6]  Chun Chen,et al.  Opinion Word Expansion and Target Extraction through Double Propagation , 2011, CL.

[7]  Jugal K. Kalita,et al.  MIFS-ND: A mutual information-based feature selection method , 2014, Expert Syst. Appl..

[8]  João Francisco Valiati,et al.  Document-level sentiment classification: An empirical comparison between SVM and ANN , 2013, Expert Syst. Appl..

[9]  Erik Cambria,et al.  Intention awareness: improving upon situation awareness in human-centric environments , 2013, Human-centric Computing and Information Sciences.

[10]  Andrea Esuli,et al.  SENTIWORDNET: A Publicly Available Lexical Resource for Opinion Mining , 2006, LREC.

[11]  Ellen Riloff,et al.  Creating Subjective and Objective Sentence Classifiers from Unannotated Texts , 2005, CICLing.

[12]  Bénédicte Goujon Text Mining for Opinion Target Detection , 2011, 2011 European Intelligence and Security Informatics Conference.

[13]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[14]  Ophir Frieder,et al.  Repeatable evaluation of search services in dynamic environments , 2007, TOIS.

[15]  Kerstin Denecke,et al.  Using SentiWordNet for multilingual sentiment analysis , 2008, 2008 IEEE 24th International Conference on Data Engineering Workshop.

[16]  Lei Zhang,et al.  Identifying Noun Product Features that Imply Opinions , 2011, ACL.

[17]  Fei Song,et al.  Feature Selection for Sentiment Analysis Based on Content and Syntax Models , 2011, Decis. Support Syst..

[18]  Dai Quoc Nguyen,et al.  Sentiment Classification on Polarity Reviews: An Empirical Study Using Rating-based Features , 2014, WASSA@ACL.

[19]  Hugo Liu,et al.  ConceptNet — A Practical Commonsense Reasoning Tool-Kit , 2004 .

[20]  John Blitzer,et al.  Biographies, Bollywood, Boom-boxes and Blenders: Domain Adaptation for Sentiment Classification , 2007, ACL.

[21]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[22]  Bruno Ohana,et al.  Sentiment Classification of Reviews Using SentiWordNet , 2009 .

[23]  Efstathios Stamatatos,et al.  Syntactic Dependency-Based N-grams as Classification Features , 2012, MICAI.

[24]  Jian Zhu,et al.  Sentiment classification using the theory of ANNs , 2010 .

[25]  Jonathon Read,et al.  Using Emoticons to Reduce Dependency in Machine Learning Techniques for Sentiment Classification , 2005, ACL.

[26]  Erik Cambria,et al.  EmoSenticSpace: A novel framework for affective common-sense reasoning , 2014, Knowl. Based Syst..

[27]  Ian H. Witten,et al.  Chapter 15 – Embedded Machine Learning , 2011 .

[28]  Luis Alfonso Ureña López,et al.  Experiments with SVM to classify opinions in different domains , 2011, Expert Syst. Appl..

[29]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[30]  Namita Mittal,et al.  Prominent feature extraction for review analysis: an empirical study , 2016, J. Exp. Theor. Artif. Intell..

[31]  Ahmed Abbasi Intelligent Feature Selection for Opinion Classification , 2010, IEEE Intell. Syst..

[32]  Namita Mittal,et al.  Sentiment classification of review documents using phrase patterns , 2013, 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[33]  Janyce Wiebe,et al.  Recognizing Contextual Polarity in Phrase-Level Sentiment Analysis , 2005, HLT.

[34]  Sotiris Kotsiantis,et al.  Text Classification Using Machine Learning Techniques , 2005 .

[35]  Erik Cambria,et al.  The CLSA Model: A Novel Framework for Concept-Level Sentiment Analysis , 2015, CICLing.

[36]  Namita Mittal,et al.  Optimal Feature Selection for Sentiment Analysis , 2013, CICLing.

[37]  Huan Liu,et al.  Efficient Feature Selection via Analysis of Relevance and Redundancy , 2004, J. Mach. Learn. Res..

[38]  Carolyn Penstein Rosé,et al.  Generalizing Dependency Features for Opinion Mining , 2009, ACL.

[39]  Christopher D. Manning,et al.  The Stanford Typed Dependencies Representation , 2008, CF+CDPE@COLING.

[40]  Hiroya Takamura,et al.  Sentiment Classification Using Word Sub-sequences and Dependency Sub-trees , 2005, PAKDD.

[41]  Qiang Ye,et al.  Sentiment classification of online reviews to travel destinations by supervised machine learning approaches , 2009, Expert Syst. Appl..

[42]  Hsinchun Chen,et al.  Sentiment analysis in multiple languages: Feature selection for opinion classification in Web forums , 2008, TOIS.

[43]  Padmini Srinivasan,et al.  Exploring Feature Definition and Selection for Sentiment Classifiers , 2011, ICWSM.

[44]  M. de Rijke,et al.  UvA-DARE ( Digital Academic Repository ) Using WordNet to measure semantic orientations of adjectives , 2004 .

[45]  Vibhu O. Mittal,et al.  Comparative Experiments on Sentiment Classification for Online Product Reviews , 2006, AAAI.

[46]  Patrick Paroubek,et al.  Text Representation Using Dependency Tree Subgraphs for Sentiment Analysis , 2011, DASFAA Workshops.

[47]  Arno Scharl,et al.  Extracting and Grounding Contextualized Sentiment Lexicons , 2013, IEEE Intelligent Systems.

[48]  Soo-Min Kim,et al.  Determining the Sentiment of Opinions , 2004, COLING.

[49]  Aoying Zhou,et al.  An information theoretic approach to sentiment polarity classification , 2012, WebQuality '12.

[50]  Deyu Li,et al.  A Feature Selection Method Based on Fisher's Discriminant Ratio for Text Sentiment Classification , 2009, WISM.

[51]  C. Osgood,et al.  The Measurement of Meaning , 1958 .

[52]  Erik Cambria,et al.  AffectiveSpace 2: Enabling Affective Intuition for Concept-Level Sentiment Analysis , 2015, AAAI.

[53]  Rui Xia,et al.  Exploring the Use of Word Relation Features for Sentiment Classification , 2010, COLING.

[54]  Maite Taboada,et al.  Lexicon-Based Methods for Sentiment Analysis , 2011, CL.

[55]  Pushpak Bhattacharyya,et al.  Incorporating Semantic Knowledge for Sentiment Analysis , 2008 .

[56]  Hsinchun Chen,et al.  A Lexicon-Enhanced Method for Sentiment Classification: An Experiment on Online Product Reviews , 2010, IEEE Intelligent Systems.

[57]  Watanabe Hideo,et al.  Deeper Sentiment Analysis Using Machine Translation Technology , 2004, COLING.

[58]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[59]  T. V. Prabhakar,et al.  Sentence Level Sentiment Analysis in the Presence of Conjuncts Using Linguistic Analysis , 2007, ECIR.

[60]  Denzil Correa,et al.  Generating Domain-Specific Ontology from Common-Sense Semantic Network for Target-Specific Sentiment Analysis , 2010 .

[61]  Kentaro Inui,et al.  Dependency Tree-based Sentiment Classification using CRFs with Hidden Variables , 2010, NAACL.

[62]  Shlomo Argamon,et al.  Using appraisal groups for sentiment analysis , 2005, CIKM '05.

[63]  George Forman,et al.  An Extensive Empirical Study of Feature Selection Metrics for Text Classification , 2003, J. Mach. Learn. Res..

[64]  David M. Pennock,et al.  Mining the peanut gallery: opinion extraction and semantic classification of product reviews , 2003, WWW '03.

[65]  Lin Dai,et al.  Improving Sentiment Classification Using Feature Highlighting and Feature Bagging , 2011, 2011 IEEE 11th International Conference on Data Mining Workshops.

[66]  Takashi Inui,et al.  Extracting Semantic Orientations of Phrases from Dictionary , 2007, NAACL.

[67]  Songbo Tan,et al.  A survey on sentiment detection of reviews , 2009, Expert Syst. Appl..

[68]  Namita Mittal,et al.  Sentiment Analysis Using Common-Sense and Context Information , 2015, Comput. Intell. Neurosci..

[69]  Michael Gamon,et al.  Sentiment classification on customer feedback data: noisy data, large feature vectors, and the role of linguistic analysis , 2004, COLING.

[70]  Andrea Esuli,et al.  Determining the semantic orientation of terms through gloss analysis , 2005, CIKM 2005.

[71]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[72]  Mike Thelwall,et al.  A Study of Information Retrieval Weighting Schemes for Sentiment Analysis , 2010, ACL.

[73]  Siddharth Patwardhan,et al.  Feature Subsumption for Opinion Analysis , 2006, EMNLP.

[74]  Jin-Cheon Na,et al.  Sentiment analysis of movie reviews on discussion boards using a linguistic approach , 2009, CIKM 2009.

[75]  Franco Salvetti,et al.  Automatic Opinion Polarity Classification of Movie Reviews , 2004 .

[76]  Namita Mittal,et al.  Enhancing Sentiment Classification Performance Using Bi-Tagged Phrases , 2013, 2013 IEEE 13th International Conference on Data Mining Workshops.

[77]  Preslav Nakov,et al.  Language-Independent Sentiment Analysis Using Subjectivity and Positional Information , 2009, RANLP.

[78]  Efstathios Stamatatos,et al.  Syntactic N-grams as machine learning features for natural language processing , 2014, Expert Syst. Appl..

[79]  Masaru Kitsuregawa,et al.  Building Lexicon for Sentiment Analysis from Massive Collection of HTML Documents , 2007, EMNLP.

[80]  Liviu P. Dinu,et al.  The Naive Bayes Classifier in Opinion Mining: In Search of the Best Feature Set , 2012, CICLing.

[81]  Vitaly Klyuev,et al.  Thematically Reinforced Explicit Semantic Analysis , 2014, ArXiv.

[82]  Christopher Potts,et al.  Learning Word Vectors for Sentiment Analysis , 2011, ACL.

[83]  Jin-Cheon Na,et al.  Phrase-Level Sentiment Polarity Classification Using Rule-Based Typed Dependencies and Additional Complex Phrases Consideration , 2012, Journal of Computer Science and Technology.

[84]  Erik Cambria,et al.  Jumping NLP Curves: A Review of Natural Language Processing Research [Review Article] , 2014, IEEE Computational Intelligence Magazine.

[85]  Namita Mittal,et al.  Concept-Level Sentiment Analysis with Dependency-Based Semantic Parsing: A Novel Approach , 2015, Cognitive Computation.

[86]  Erik Cambria,et al.  SenticNet 2: A Semantic and Affective Resource for Opinion Mining and Sentiment Analysis , 2012, FLAIRS.

[87]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[88]  Erik Cambria,et al.  SeNTU: Sentiment Analysis of Tweets by Combining a Rule-based Classifier with Supervised Learning , 2015, *SEMEVAL.

[89]  Kazutaka Shimada,et al.  Movie Review Classification Based on a Multiple Classifier , 2007, PACLIC.

[90]  Themis Palpanas,et al.  Survey on mining subjective data on the web , 2011, Data Mining and Knowledge Discovery.

[91]  Aoying Zhou,et al.  Assembling the Optimal Sentiment Classifiers , 2012, WISE.

[92]  Chng Eng Siong,et al.  Modelling Public Sentiment in Twitter: Using Linguistic Patterns to Enhance Supervised Learning , 2015, CICLing.

[93]  Jin Zhang,et al.  An empirical study of sentiment analysis for chinese documents , 2008, Expert Syst. Appl..

[94]  Pedro Larrañaga,et al.  A review of feature selection techniques in bioinformatics , 2007, Bioinform..

[95]  Björn W. Schuller,et al.  New Avenues in Opinion Mining and Sentiment Analysis , 2013, IEEE Intelligent Systems.

[96]  Dipankar Das,et al.  Enriching SenticNet Polarity Scores through Semi-Supervised Fuzzy Clustering , 2012, 2012 IEEE 12th International Conference on Data Mining Workshops.

[97]  Nigel Collier,et al.  Sentiment Analysis using Support Vector Machines with Diverse Information Sources , 2004, EMNLP.

[98]  Robert J. Hilderman,et al.  Categorical Proportional Difference: A Feature Selection Method for Text Categorization , 2008, AusDM.

[99]  Namita Mittal,et al.  Machine Learning Approaches for Sentiment Analysis , 2014 .

[100]  Erik Cambria,et al.  Fusing audio, visual and textual clues for sentiment analysis from multimodal content , 2016, Neurocomputing.

[101]  Namita Mittal,et al.  Categorical Probability Proportion Difference (CPPD): A Feature Selection Method for Sentiment Classification , 2012 .

[102]  Namita Mittal,et al.  Sentiment Classification using Rough Set based Hybrid Feature Selection , 2013, WASSA@NAACL-HLT.

[103]  Alistair Kennedy,et al.  SENTIMENT CLASSIFICATION of MOVIE REVIEWS USING CONTEXTUAL VALENCE SHIFTERS , 2006, Comput. Intell..

[104]  Akshi Kumar,et al.  Sentiment Analysis: A Perspective on its Past, Present and Future , 2012 .

[105]  Alexander Gelbukh Computational Linguistics and Intelligent Text Processing : 14th International Conference, CICLing 2013, Samos, Greece, March 24-30, 2013, Proceedings, Part I , 2013 .

[106]  Vincent Ng,et al.  Examining the Role of Linguistic Knowledge Sources in the Automatic Identification and Classification of Reviews , 2006, ACL.

[107]  Chen Gui,et al.  A Rule-Based Approach to Aspect Extraction from Product Reviews , 2014, SocialNLP@COLING.

[108]  Chih-Ping Wei,et al.  Understanding what concerns consumers: a semantic approach to product feature extraction from consumer reviews , 2010, Inf. Syst. E Bus. Manag..

[109]  Erik Cambria,et al.  A Common-Sense Based API for Concept-Level Sentiment Analysis , 2014 .

[110]  Erik Cambria,et al.  Merging SenticNet and WordNet-Affect emotion lists for sentiment analysis , 2012, 2012 IEEE 11th International Conference on Signal Processing.

[111]  Namita Mittal,et al.  Semantic Feature Clustering for Sentiment Analysis of English Reviews , 2014 .

[112]  Erik Cambria,et al.  Common Sense Knowledge Based Personality Recognition from Text , 2013, MICAI.

[113]  Michael L. Littman,et al.  Measuring praise and criticism: Inference of semantic orientation from association , 2003, TOIS.

[114]  Lan Wang,et al.  Sentiment Classification of Documents Based on Latent Semantic Analysis , 2011 .

[115]  Vasudeva Varma,et al.  Towards Enhanced Opinion Classification using NLP Techniques. , 2011 .

[116]  Erik Cambria,et al.  Sentic patterns: Dependency-based rules for concept-level sentiment analysis , 2014, Knowl. Based Syst..

[117]  Nirmalie Wiratunga,et al.  Selecting Bi-Tags for Sentiment Analysis of Text , 2007, SGAI Conf..

[118]  Dipankar Das,et al.  Enhanced SenticNet with Affective Labels for Concept-Based Opinion Mining , 2013, IEEE Intelligent Systems.

[119]  Subhabrata Mukherjee,et al.  Sentiment Aggregation using ConceptNet Ontology , 2013, IJCNLP.

[120]  Hongliang Yu,et al.  A study of supervised term weighting scheme for sentiment analysis , 2014, Expert Syst. Appl..

[121]  Seong Joon Yoo,et al.  Senti-lexicon and improved Naïve Bayes algorithms for sentiment analysis of restaurant reviews , 2012, Expert Syst. Appl..

[122]  S. Narayanamoorthy,et al.  The Intelligence of Dual Simplex Method to Solve Linear Fractional Fuzzy Transportation Problem , 2015, Comput. Intell. Neurosci..

[123]  Philip J. Stone,et al.  A computer approach to content analysis: studies using the General Inquirer system , 1963, AFIPS Spring Joint Computing Conference.

[124]  Peter D. Turney Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews , 2002, ACL.

[125]  Bo Pang,et al.  A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts , 2004, ACL.

[126]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[127]  Eric Brill,et al.  Reducing the human overhead in text categorization , 2006, KDD '06.

[128]  Takashi Inui,et al.  Latent Variable Models for Semantic Orientations of Phrases , 2006, EACL.

[129]  Iryna Gurevych,et al.  A Comparative Study of Feature Extraction Algorithms in Customer Reviews , 2008, 2008 IEEE International Conference on Semantic Computing.

[130]  Fei-Yue Wang,et al.  Sentiment analysis of Chinese documents: From sentence to document level , 2009 .

[131]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[132]  Takashi Inui,et al.  Extracting Semantic Orientations of Words using Spin Model , 2005, ACL.

[133]  Rui Xia,et al.  Ensemble of feature sets and classification algorithms for sentiment classification , 2011, Inf. Sci..

[134]  Timothy W. Finin,et al.  Delta TFIDF: An Improved Feature Space for Sentiment Analysis , 2009, ICWSM.

[135]  Khurshid Ahmad,et al.  Sentiment Polarity Identification in Financial News: A Cohesion-based Approach , 2007, ACL.

[136]  Xia Wang,et al.  Sentiment Classification through Combining Classifiers with Multiple Feature Sets , 2007, 2007 International Conference on Natural Language Processing and Knowledge Engineering.

[137]  Fei Song,et al.  Comparison of Feature Selection Methods for Sentiment Analysis , 2010, Canadian Conference on AI.