Deep Learning Enhanced with Graph Knowledge for Sentiment Analysis

The traditional way to address the problem of sentiment classification is based in Machine Learning techniques; however, these models are not able to grasp all the richness of the text that comes from different social media, personal web pages, blogs, etc., ignoring the semantic of the text. Knowledge Graphs give a way to extract structured knowledge from images and texts, in order to facilitate their semantic analysis. In this work, we propose a new hybrid approach for Sentiment Analysis based on Knowledge Graphs and Deep Learning techniques, to identify the sentiment polarity (positive or negative) in short documents, particularly in tweets. We represent the tweets using graphs, then graph similarity metrics and a Deep Learning classification algorithm are applied to produce sentiment predictions. This approach facilitates the traceability and explainability of the classification results, since it is possible to visually inspect the graphs. We compare our proposal with character n-gram embeddings based Deep Learning models to perform Sentiment Analysis. Results show that our proposal is able to outperforms classical n-gram models, with a recall up to 89% and F1-score of 88%.

[1]  Paolo Rosso,et al.  Cross-domain polarity classification using a knowledge-enhanced meta-classifier , 2015, Knowl. Based Syst..

[2]  Konstantinos Tserpes,et al.  Sentiment Analysis using Word-Graphs , 2016, WIMS.

[3]  Navneet Kaur,et al.  Opinion mining and sentiment analysis , 2016, 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom).

[4]  J. Fernando Sánchez-Rada,et al.  A Linked Data Approach to Sentiment and Emotion Analysis of Twitter in the Financial Domain , 2014, WaSABi-FEOSW@ESWC.

[5]  Klaus-Robert Müller,et al.  Explaining Recurrent Neural Network Predictions in Sentiment Analysis , 2017, WASSA@EMNLP.

[6]  Chen Yuda,et al.  Research on Chinese Micro-Blog Sentiment Analysis Based on Deep Learning , 2015, 2015 8th International Symposium on Computational Intelligence and Design (ISCID).

[7]  Elizabeth Chang,et al.  Sentiment Analysis of Specific Product's Features Using Product Tree for Application in New Product Development , 2017, INCoS.

[8]  Preslav Nakov,et al.  SemEval-2016 Task 4: Sentiment Analysis in Twitter , 2016, *SEMEVAL.

[9]  Jingyuan Zhang,et al.  Knowledge Graph Embedding Based Question Answering , 2019, WSDM.

[10]  Deb Roy,et al.  Audio-Visual Sentiment Analysis for Learning Emotional Arcs in Movies , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[11]  Yixin Cao,et al.  KGAT: Knowledge Graph Attention Network for Recommendation , 2019, KDD.

[12]  Erik Cambria,et al.  Affective Computing and Sentiment Analysis , 2016, IEEE Intelligent Systems.

[13]  C. Roussey,et al.  Feature vector construction combining structure and content for document classification , 2012, 2012 6th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications (SETIT).

[14]  Marian Stewart Bartlett,et al.  Exploring Bag of Words Architectures in the Facial Expression Domain , 2012, ECCV Workshops.

[15]  Gorjan Alagic,et al.  #p , 2019, Quantum information & computation.

[16]  Kayvan Bijari,et al.  Leveraging deep graph-based text representation for sentiment polarity applications , 2020, Expert Syst. Appl..

[17]  Maite Taboada,et al.  Sentiment Analysis: An Overview from Linguistics , 2016 .

[18]  Darnes Vilariño Ayala,et al.  UDLAP: Sentiment Analysis Using a Graph-Based Representation , 2015, *SEMEVAL.

[19]  Alessandro Moschitti,et al.  Twitter Sentiment Analysis with Deep Convolutional Neural Networks , 2015, SIGIR.

[20]  David Sontag,et al.  Learning a Health Knowledge Graph from Electronic Medical Records , 2017, Scientific Reports.

[21]  Bo Xu,et al.  Recursive Deep Learning for Sentiment Analysis over Social Data , 2014, 2014 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT).

[22]  Doaa Mohey El Din Mohamed Hussein,et al.  A survey on sentiment analysis challenges , 2016, Journal of King Saud University - Engineering Sciences.

[23]  Frédéric Jurie,et al.  Modeling spatial layout with fisher vectors for image categorization , 2011, 2011 International Conference on Computer Vision.

[24]  Fatih Uzdilli,et al.  Potential and Limitations of Commercial Sentiment Detection Tools , 2013, ESSEM@AI*IA.

[25]  D. Oliveira,et al.  Can social media reveal the preferences of voters? A comparison between sentiment analysis and traditional opinion polls , 2017 .

[26]  Roman Senkerik,et al.  Artificial Intelligence Perspectives in Intelligent Systems - Proceedings of the 5th Computer Science On-line Conference 2016 (CSOC2016), Vol 1 , 2016, CSOC.

[27]  Gui Xiaolin,et al.  Deep Convolution Neural Networks for Twitter Sentiment Analysis , 2018, IEEE Access.

[28]  Hidekazu Yanagimoto,et al.  Document similarity estimation for sentiment analysis using neural network , 2013, 2013 IEEE/ACIS 12th International Conference on Computer and Information Science (ICIS).

[29]  Liu Xiao-xia Study on mutual information-based feature selection in text categorization , 2010 .

[30]  Mohamed M. Mostafa,et al.  More than words: Social networks' text mining for consumer brand sentiments , 2013, Expert Syst. Appl..

[31]  Bo Wang,et al.  Learning Long-Term Structural Dependencies for Video Salient Object Detection , 2020, IEEE Transactions on Image Processing.

[32]  Horst Bunke,et al.  On a relation between graph edit distance and maximum common subgraph , 1997, Pattern Recognit. Lett..