Interactive POS-aware network for aspect-level sentiment classification

Abstract Existing aspect-level sentiment-classification models completely rely on the learning from given datasets. However, these are easily misled by biased samples, resulting in learning some ill-suited rules that limit their potential. The information of some specific part-of-speech (POS) categories often indicates the word sentiment polarity, which can be introduced as prior knowledge to facilitate prediction of the model. Accordingly, we propose an interactive POS-aware network (IPAN) that explicitly introduces the POS information as reliable guidance to assist the model in accurately predicting sentiment polarity. We distinguish the information of different POS categories using a POS-filter gate and reinforce the features extracted from adjectives, adverbs, and verbs via a POS-highlighting attention mechanism. This enables the model to concentrate on the words that contain significant sentiment orientations and to obtain the most practical learning experience. To emphasize the target information, we construct a target-context gate that enables the interaction of the target information with contexts; consequently, the model considerably focuses on target-related sentiment features. The experiments on SemEval2014 and Twitter datasets verify that our IPAN consistently outperforms the current state-of-the-art methods.

[1]  Geoffrey E. Hinton,et al.  Transforming Auto-Encoders , 2011, ICANN.

[2]  Erik Cambria,et al.  OntoSenticNet: A Commonsense Ontology for Sentiment Analysis , 2018, IEEE Intelligent Systems.

[3]  Michael L. Littman,et al.  Measuring praise and criticism: Inference of semantic orientation from association , 2003, TOIS.

[4]  Mike Thelwall,et al.  Sentiment Analysis Is a Big Suitcase , 2017, IEEE Intelligent Systems.

[5]  Lidong Bing,et al.  Recurrent Attention Network on Memory for Aspect Sentiment Analysis , 2017, EMNLP.

[6]  Rohini K. Srihari,et al.  Using Verbs and Adjectives to Automatically Classify Blog Sentiment , 2006, AAAI Spring Symposium: Computational Approaches to Analyzing Weblogs.

[7]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[8]  Raymond Y. K. Lau,et al.  A Probabilistic Generative Model for Mining Cybercriminal Networks from Online Social Media , 2014, IEEE Computational Intelligence Magazine.

[9]  Juan Martínez-Romo,et al.  Co-occurrence graphs for word sense disambiguation in the biomedical domain , 2018, Artif. Intell. Medicine.

[10]  Erik Cambria,et al.  Sentiment and Sarcasm Classification With Multitask Learning , 2019, IEEE Intelligent Systems.

[11]  Diego Reforgiato Recupero,et al.  Frame-Based Detection of Opinion Holders and Topics: A Model and a Tool , 2014, IEEE Computational Intelligence Magazine.

[12]  Erik Cambria,et al.  Word Polarity Disambiguation Using Bayesian Model and Opinion-Level Features , 2014, Cognitive Computation.

[13]  Björn W. Schuller,et al.  SenticNet 4: A Semantic Resource for Sentiment Analysis Based on Conceptual Primitives , 2016, COLING.

[14]  Philip S. Yu,et al.  A holistic lexicon-based approach to opinion mining , 2008, WSDM '08.

[15]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[16]  Trang Uyen Tran,et al.  Bidirectional Independently Long Short-Term Memory and Conditional Random Field Integrated Model for Aspect Extraction in Sentiment Analysis , 2019, Frontiers in Intelligent Computing: Theory and Applications.

[17]  J. Mikels,et al.  Characterization of the Affective Norms for English Words by discrete emotional categories , 2007, Behavior research methods.

[18]  Mauro Dragoni,et al.  A Fuzzy System for Concept-Level Sentiment Analysis , 2014, SemWebEval@ESWC.

[19]  Erik Cambria,et al.  Deep Learning-Based Document Modeling for Personality Detection from Text , 2017, IEEE Intelligent Systems.

[20]  Felipe Bravo-Marquez,et al.  Meta-level sentiment models for big social data analysis , 2014, Knowl. Based Syst..

[21]  Erik Cambria,et al.  Affective Computing and Sentiment Analysis , 2016, IEEE Intelligent Systems.

[22]  Mei-Juan Liu,et al.  YSC-DSAA: An Approach to Disambiguate Sentiment Ambiguous Adjectives Based on SAAOL , 2010, SemEval@ACL.

[23]  Paolo Rosso,et al.  A multidimensional approach for detecting irony in Twitter , 2013, Lang. Resour. Evaluation.

[24]  Erik Cambria,et al.  EmoSenticSpace: A novel framework for affective common-sense reasoning , 2014, Knowl. Based Syst..

[25]  Hugo Liu,et al.  ConceptNet — A Practical Commonsense Reasoning Tool-Kit , 2004 .

[26]  Roberto Navigli,et al.  Breaking Through the 80% Glass Ceiling: Raising the State of the Art in Word Sense Disambiguation by Incorporating Knowledge Graph Information , 2020, ACL.

[27]  Tieyun Qian,et al.  Transfer Capsule Network for Aspect Level Sentiment Classification , 2019, ACL.

[28]  Erik Cambria,et al.  Big Social Data Analysis , 2013 .

[29]  Cícero Nogueira dos Santos,et al.  Deep Convolutional Neural Networks for Sentiment Analysis of Short Texts , 2014, COLING.

[30]  Kostas E. Psannis,et al.  Social networking data analysis tools & challenges , 2016, Future Gener. Comput. Syst..

[31]  Jianfei Yu,et al.  Instance-based Domain Adaptation via Multiclustering Logistic Approximation , 2018, IEEE Intelligent Systems.

[32]  Diego Reforgiato Recupero,et al.  Sentiment Analysis: Adjectives and Adverbs are Better than Adjectives Alone , 2007, ICWSM.

[33]  Yuexian Hou,et al.  A Position-aware Bidirectional Attention Network for Aspect-level Sentiment Analysis , 2018, COLING.

[34]  Björn W. Schuller,et al.  Statistical Approaches to Concept-Level Sentiment Analysis , 2013, IEEE Intell. Syst..

[35]  Janyce Wiebe,et al.  Recognizing Contextual Polarity in Phrase-Level Sentiment Analysis , 2005, HLT.

[36]  Suresh Manandhar,et al.  SemEval-2014 Task 4: Aspect Based Sentiment Analysis , 2014, *SEMEVAL.

[37]  Ari Rappoport,et al.  ICWSM - A Great Catchy Name: Semi-Supervised Recognition of Sarcastic Sentences in Online Product Reviews , 2010, ICWSM.

[38]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[39]  Fabrício Benevenuto,et al.  iFeel: a system that compares and combines sentiment analysis methods , 2014, WWW.

[40]  Haoran Xie,et al.  Segment-Level Joint Topic-Sentiment Model for Online Review Analysis , 2019, IEEE Intelligent Systems.

[41]  Janyce Wiebe,et al.  Effects of Adjective Orientation and Gradability on Sentence Subjectivity , 2000, COLING.

[42]  Janyce Wiebe,et al.  Learning Subjective Adjectives from Corpora , 2000, AAAI/IAAI.

[43]  Erik Cambria,et al.  Sentic Computing , 2015, Cognitive Computation.

[44]  Diego Reforgiato Recupero,et al.  Sentilo: Frame-Based Sentiment Analysis , 2014, Cognitive Computation.

[45]  Pradip Kumar Bala,et al.  Sarcasm detection in microblogs using Naïve Bayes and fuzzy clustering , 2017 .

[46]  David E. Losada,et al.  An empirical study of sentence features for subjectivity and polarity classification , 2014, Inf. Sci..

[47]  Christopher Potts,et al.  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank , 2013, EMNLP.

[48]  Noémie Elhadad,et al.  An Unsupervised Aspect-Sentiment Model for Online Reviews , 2010, NAACL.

[49]  Claire Cardie,et al.  Annotating Expressions of Opinions and Emotions in Language , 2005, Lang. Resour. Evaluation.

[50]  Ellen Riloff,et al.  Creating Subjective and Objective Sentence Classifiers from Unannotated Texts , 2005, CICLing.

[51]  Björn W. Schuller,et al.  Knowledge-Based Approaches to Concept-Level Sentiment Analysis , 2013, IEEE Intell. Syst..

[52]  Likun Qiu,et al.  SELC: a self-supervised model for sentiment classification , 2009, CIKM.

[53]  Chun Chen,et al.  Opinion Word Expansion and Target Extraction through Double Propagation , 2011, CL.

[54]  Erik Cambria,et al.  Sentiment Data Flow Analysis by Means of Dynamic Linguistic Patterns , 2015, IEEE Computational Intelligence Magazine.

[55]  Li Zhao,et al.  Attention-based LSTM for Aspect-level Sentiment Classification , 2016, EMNLP.

[56]  Davide Anguita,et al.  Statistical Learning Theory and ELM for Big Social Data Analysis , 2016, IEEE Computational Intelligence Magazine.

[57]  Patrick Paroubek,et al.  Twitter Based System: Using Twitter for Disambiguating Sentiment Ambiguous Adjectives , 2010, *SEMEVAL.

[58]  Bing Liu,et al.  Sentiment Analysis and Opinion Mining , 2012, Synthesis Lectures on Human Language Technologies.

[59]  Yanghui Rao,et al.  Contextual Sentiment Topic Model for Adaptive Social Emotion Classification , 2016, IEEE Intelligent Systems.

[60]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[61]  Arno Scharl,et al.  Aspect-Based Extraction and Analysis of Affective Knowledge from Social Media Streams , 2017, IEEE Intelligent Systems.

[62]  P. Kroeger Analyzing Grammar: An Introduction , 2005 .

[63]  Dongyan Zhao,et al.  Multi-grained Attention Network for Aspect-Level Sentiment Classification , 2018, EMNLP.

[64]  Benjamin Ka-Yin T'sou,et al.  CityU-DAC: Disambiguating Sentiment-Ambiguous Adjectives within Context , 2010, SemEval@ACL.

[65]  Ari Rappoport,et al.  Semi-Supervised Recognition of Sarcasm in Twitter and Amazon , 2010, CoNLL.