Sentic patterns: Dependency-based rules for concept-level sentiment analysis

The Web is evolving through an era where the opinions of users are getting increasingly important and valuable. The distillation of knowledge from the huge amount of unstructured information on the Web can be a key factor for tasks such as social media marketing, branding, product positioning, and corporate reputation management. These online social data, however, remain hardly accessible to computers, as they are specifically meant for human consumption. The automatic analysis of online opinions involves a deep understanding of natural language text by machines, from which we are still very far. To this end, concept-level sentiment analysis aims to go beyond a mere word-level analysis of text and provide novel approaches to opinion mining and sentiment analysis that enable a more efficient passage from (unstructured) textual information to (structured) machine-processable data. A recent knowledge-based technology in this context is sentic computing, which relies on the ensemble application of common-sense computing and the psychology of emotions to infer the conceptual and affective information associated with natural language. Sentic computing, however, is limited by the richness of the knowledge base and by the fact that the bag-of-concepts model, despite more sophisticated than bag-of-words, misses out important discourse structure information that is key for properly detecting the polarity conveyed by natural language opinions. In this work, we introduce a novel paradigm to concept-level sentiment analysis that merges linguistics, common-sense computing, and machine learning for improving the accuracy of tasks such as polarity detection. By allowing sentiments to flow from concept to concept based on the dependency relation of the input sentence, in particular, we achieve a better understanding of the contextual role of each concept within the sentence and, hence, obtain a polarity detection engine that outperforms state-of-the-art statistical methods.

[1]  Carla Bazzanella,et al.  Emotions, language, and context , 2004 .

[2]  Jane Yung-jen Hsu,et al.  Building a Concept-Level Sentiment Dictionary Based on Commonsense Knowledge , 2013, IEEE Intelligent Systems.

[3]  John Blitzer,et al.  Biographies, Bollywood, Boom-boxes and Blenders: Domain Adaptation for Sentiment Classification , 2007, ACL.

[4]  Eva Krumhuber,et al.  Moving Smiles: The Role of Dynamic Components for the Perception of the Genuineness of Smiles , 2005 .

[5]  Sophie Repp,et al.  Negation in Gapping , 2009 .

[6]  Chihli Hung,et al.  Using Objective Words in SentiWordNet to Improve Word-of-Mouth Sentiment Classification , 2013, IEEE Intelligent Systems.

[7]  Jacques Jayez,et al.  Additivity and probability , 2013 .

[8]  J. Anscombre,et al.  Deux mais en français , 1977 .

[9]  Philip H. Mirvis Flow: The Psychology of Optimal Experience , 1991 .

[10]  Jing Fan,et al.  A Rapid Simulation System for Decision Making in Intelligent Forest Management , 2013, IEEE Intelligent Systems.

[11]  Christopher D. Manning Part-of-Speech Tagging from 97% to 100%: Is It Time for Some Linguistics? , 2011, CICLing.

[12]  Elizabeth Coppock,et al.  Principles of the Exclusive Muddle , 2014, J. Semant..

[13]  Carlo Strapparava,et al.  WordNet Affect: an Affective Extension of WordNet , 2004, LREC.

[14]  Ahmet Aker,et al.  Summarizing Online Reviews Using Aspect Rating Distributions and Language Modeling , 2013, IEEE Intelligent Systems.

[15]  G. Fauconnier,et al.  The Way We Think: Conceptual Blending and the Mind''s Hidden Complexities. Basic Books , 2002 .

[16]  Hwee Tou Ng,et al.  A PDTB-styled end-to-end discourse parser , 2012, Natural Language Engineering.

[17]  Erik Cambria,et al.  Sentic Computing: Techniques, Tools, and Applications , 2012 .

[18]  Sandro Ridella,et al.  Circular backpropagation networks for classification , 1997, IEEE Trans. Neural Networks.

[19]  Edda Weigand,et al.  Emotion in dialogic interaction : advances in the complex , 2004 .

[20]  Dianhui Wang,et al.  Extreme learning machines: a survey , 2011, Int. J. Mach. Learn. Cybern..

[21]  Alex Lascarides,et al.  Logics of Conversation , 2005, Studies in natural language processing.

[22]  Grégoire Winterstein,et al.  What but-sentences argue for: An argumentative analysis of but☆ , 2012 .

[23]  桐山 伸也 "The Emotion Machine: Commonsense Thinking, Artificial Intelligence, and the Future of the Human Mind," Marvin Minsky, Simon & Schuster, 2006(私のすすめるこの一冊,コーヒーブレイク) , 2007 .

[24]  Fei Wang,et al.  Exploiting Discourse Relations for Sentiment Analysis , 2012, COLING.

[25]  Erik Cambria,et al.  Affective Common Sense Knowledge Acquisition for Sentiment Analysis , 2012, LREC.

[26]  Henry Anaya-Sánchez,et al.  Retrieving Product Features and Opinions from Customer Reviews , 2013, IEEE Intelligent Systems.

[27]  Robert Stalnaker,et al.  Presuppositions of Compound Sentences , 2008 .

[28]  Erik Cambria,et al.  SenticNet 3: A Common and Common-Sense Knowledge Base for Cognition-Driven Sentiment Analysis , 2014, AAAI.

[29]  Hongming Zhou,et al.  Representational Learning with ELMs for Big Data , 2013 .

[30]  Paolo Gastaldo,et al.  An ELM-based model for affective analogical reasoning , 2015, Neurocomputing.

[31]  Christopher Potts,et al.  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank , 2013, EMNLP.

[32]  R. Plutchik The Nature of Emotions , 2001 .

[33]  Grégoire Winterstein,et al.  Layered Meanings and Bayesian Argumentation: The Case of Exclusives , 2015 .

[34]  Arno Scharl,et al.  Extracting and Grounding Contextualized Sentiment Lexicons , 2013, IEEE Intelligent Systems.

[35]  M. Minsky The Emotion Machine: Commonsense Thinking, Artificial Intelligence, and the Future of the Human Mind , 2006 .

[36]  G. Reeke The society of mind , 1991 .

[37]  Björn W. Schuller,et al.  YouTube Movie Reviews: Sentiment Analysis in an Audio-Visual Context , 2013, IEEE Intelligent Systems.

[38]  Rui Xia,et al.  Feature Ensemble Plus Sample Selection: Domain Adaptation for Sentiment Classification , 2013, IEEE Intelligent Systems.

[39]  Victor C. M. Leung,et al.  Extreme Learning Machines [Trends & Controversies] , 2013, IEEE Intelligent Systems.

[40]  Verónica Pérez-Rosas,et al.  Multimodal Sentiment Analysis of Spanish Online Videos , 2013, IEEE Intelligent Systems.

[41]  Sravanti L. Sanivarapu Emotion , 2020, Indian journal of psychiatry.

[42]  M. Bradley,et al.  Affective Norms for English Words (ANEW): Instruction Manual and Affective Ratings , 1999 .

[43]  M. Bradley,et al.  Affective Normsfor English Words (ANEW): Stimuli, instruction manual and affective ratings (Tech Report C-1) , 1999 .

[44]  Andrea Esuli,et al.  SENTIWORDNET: A Publicly Available Lexical Resource for Opinion Mining , 2006, LREC.

[45]  Cristina Bosco,et al.  Developing Corpora for Sentiment Analysis: The Case of Irony and Senti-TUT , 2013, IEEE Intelligent Systems.

[46]  Uzay Kaymak,et al.  Polarity analysis of texts using discourse structure , 2011, CIKM '11.

[47]  Andrew Y. Ng,et al.  Semantic Compositionality through Recursive Matrix-Vector Spaces , 2012, EMNLP.

[48]  David I. Beaver Presupposition and Assertion in Dynamic Semantics , 2001 .

[49]  C. Lanczos An iteration method for the solution of the eigenvalue problem of linear differential and integral operators , 1950 .

[50]  Erik Cambria,et al.  Jumping NLP Curves: A Review of Natural Language Processing Research [Review Article] , 2014, IEEE Computational Intelligence Magazine.

[51]  Nicholas Asher,et al.  Measuring the Effect of Discourse Structure on Sentiment Analysis , 2013, CICLing.

[52]  Chris D. Paice,et al.  Another stemmer , 1990, SIGF.

[53]  Arno Scharl,et al.  Extracting and Grounding Context-Aware Sentiment Lexicons , 2013 .

[54]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .

[55]  Bo Pang,et al.  Seeing Stars: Exploiting Class Relationships for Sentiment Categorization with Respect to Rating Scales , 2005, ACL.

[56]  Guang-Bin Huang,et al.  An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels , 2014, Cognitive Computation.

[57]  A. K. Rigler,et al.  Accelerating the convergence of the back-propagation method , 1988, Biological Cybernetics.

[58]  Erik Cambria,et al.  Big Social Data Analysis , 2013 .

[59]  Christopher Potts The logic of conventional implicatures , 2004 .

[60]  David I. Beaver,et al.  What projects and why , 2010 .

[61]  김용수,et al.  Extreme Learning Machine 기반 퍼지 패턴 분류기 설계 , 2015 .

[62]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[63]  A. Abbass Emotion, Development, and Self-Organization: Dynamic Systems Approaches to Emotional Development. , 2004 .

[64]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[65]  L. F. Barrett Solving the Emotion Paradox: Categorization and the Experience of Emotion , 2006, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[66]  Dipankar Das,et al.  Enhanced SenticNet with Affective Labels for Concept-Based Opinion Mining , 2013, IEEE Intelligent Systems.

[67]  Björn Schuller,et al.  YouTube Movie Reviews: In, Cross, and Open-domain Sentiment Analysis in an Audiovisual Context , 2013 .

[68]  Luis Vicente,et al.  On the syntax of adversative coordination , 2010 .

[69]  Carolyn Penstein Rosé,et al.  Generalizing Dependency Features for Opinion Mining , 2009, ACL.