Semantic Sentiment Analysis Challenge at ESWC2017

Sentiment Analysis is a widely studied research field in both research and industry, and there are different approaches for addressing sentiment analysis related tasks. Sentiment Analysis engines implement approaches spanning from lexicon-based techniques, to machine learning, or involving syntactical rules analysis. Such systems are already evaluated in international research challenges. However, Semantic Sentiment Analysis approaches, which take into account or rely also on large semantic knowledge bases and implement Semantic Web best practices, are not under specific experimental evaluation and comparison by other international challenges. Such approaches may potentially deliver higher performance, since they are also able to analyze the implicit, semantics features associated with natural language concepts. In this paper, we present the fourth edition of the Semantic Sentiment Analysis Challenge, in which systems implementing or relying on semantic features are evaluated in a competition involving large test sets, and on different sentiment tasks. Systems merely based on syntax/word-count or just lexicon-based approaches have been excluded by the evaluation. Then, we present the results of the evaluation for each task and show the winner of the most innovative approach award, that combines several knowledge bases for addressing the sentiment analysis task.

[1]  Diego Reforgiato Recupero,et al.  Challenge on Fine-Grained Sentiment Analysis Within ESWC2016 , 2016, SemWebEval@ESWC.

[2]  Diego Reforgiato Recupero,et al.  ESWC 15 Challenge on Concept-Level Sentiment Analysis , 2015, SemWebEval@ESWC.

[3]  Roman Kern,et al.  Exploiting Propositions for Opinion Mining , 2016, SemWebEval@ESWC.

[4]  Harald Sack,et al.  Semantic Web Challenges , 2016, Communications in Computer and Information Science.

[5]  Diego Reforgiato Recupero,et al.  ESWC'14 Challenge on Concept-Level Sentiment Analysis , 2014, SemWebEval@ESWC.

[6]  Bing Liu,et al.  Sentiment Analysis and Opinion Mining , 2012, Synthesis Lectures on Human Language Technologies.

[7]  Diego Reforgiato Recupero,et al.  Sentilo: Frame-Based Sentiment Analysis , 2014, Cognitive Computation.

[8]  Fabien L. Gandon,et al.  Semantic Web Evaluation Challenges , 2015, Communications in Computer and Information Science.

[9]  Dipankar Das,et al.  A Practical Guide to Sentiment Analysis , 2017 .

[10]  Diego Reforgiato Recupero,et al.  Frame-Based Detection of Opinion Holders and Topics: A Model and a Tool , 2014, IEEE Computational Intelligence Magazine.

[11]  Mauro Dragoni,et al.  A Knowledge-Based Approach for Aspect-Based Opinion Mining , 2016, SemWebEval@ESWC.

[12]  John Blitzer,et al.  Biographies, Bollywood, Boom-boxes and Blenders: Domain Adaptation for Sentiment Classification , 2007, ACL.

[13]  Diego Reforgiato Recupero,et al.  Language Independent Sentiment Analysis of the Shukran Social Network Using Apache Spark , 2017, SemWebEval@ESWC.

[14]  Filip De Turck,et al.  Personalized Robotic Intervention Strategy by Using Semantics for People with Dementia in Nursing Homes , 2017, AnSWeR@ESWC.

[15]  Mauro Dragoni,et al.  The IRMUDOSA System at ESWC-2017 Challenge on Semantic Sentiment Analysis , 2017, SemWebEval@ESWC.

[16]  Mauro Dragoni,et al.  The NeuroSent System at ESWC-2018 Challenge on Semantic Sentiment Analysis , 2018, SemWebEval@ESWC.

[17]  Diego Reforgiato Recupero,et al.  Joint Proceedings of the 1st Workshop on Semantic Sentiment Analysis (SSA2014), and the Workshop on Social Media and Linked Data for Emergency Response (SMILE 2014) co-located with 11th European Seman , 2015 .

[18]  Mauro Dragoni,et al.  An Information Retrieval-Based System for Multi-domain Sentiment Analysis , 2015, SemWebEval@ESWC.

[19]  Diego Reforgiato Recupero,et al.  Fine-Grained Sentiment Analysis on Financial Microblogs and News Headlines , 2017, SemWebEval@ESWC.