Sentiment analysis and Twitter: a game proposal

Pervasive sensing of people’s opinions is becoming critical in strategic decision processes, as it may be helpful in identifying problems and strengthening strategies. A recent research trend is to understand users’ opinions through a sentiment analysis of contents published in the Twitter platform. This approach involves two challenges: the large volume of available data and the large variety of used languages combined with the brevity of texts. The former makes manual analysis unreasonable, whereas the latter complicates any type of automatic analysis. Since sentiment analysis is a difficult process for computers, but it is quite simple for humans, in this article, we transform the sentiment analysis process into a game. Indeed, we consider the game with a purpose approach and we propose a game that involves users in classifying the polarity (e.g., positive, negative, neutral) and the sentiment (e.g., joy, surprise, sadness) of tweets. To evaluate the proposal, we used a dataset of 52,877 tweets, we developed a Web-based game, we invited people to play the game, and we validated the results through two different methods: ground-truth and manual assessment. The obtained results showed that the game approach is effective in measuring people’ sentiments and also highlighted that participants liked to play the game.

[1]  Preslav Nakov,et al.  SemEval-2013 Task 2: Sentiment Analysis in Twitter , 2013, *SEMEVAL.

[2]  Michael Riegler,et al.  PictureSort: gamification of image ranking , 2014, GamifIR '14.

[3]  Marco Furini,et al.  TSentiment: On gamifying Twitter sentiment analysis , 2016, 2016 IEEE Symposium on Computers and Communication (ISCC).

[4]  Ben A. Amaba,et al.  Industrial and Business Systems for Smart Cities , 2014, EMASC '14.

[5]  Paolo Rosso,et al.  Irony Detection in Twitter , 2016, ACM Trans. Internet Techn..

[6]  G. Galster The Mechanism(s) of Neighbourhood Effects: Theory, Evidence, and Policy Implications , 2012 .

[7]  Marco Furini,et al.  Understanding the City to Make It Smart , 2015, IoT 360.

[8]  M. Hossain,et al.  Users' motivation to participate in online crowdsourcing platforms , 2012, 2012 International Conference on Innovation Management and Technology Research.

[9]  Andrea Esuli,et al.  SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining , 2010, LREC.

[10]  Marco Furini,et al.  TRank: Ranking Twitter users according to specific topics , 2015, 2015 12th Annual IEEE Consumer Communications and Networking Conference (CCNC).

[11]  Finn Årup Nielsen,et al.  A New ANEW: Evaluation of a Word List for Sentiment Analysis in Microblogs , 2011, #MSM.

[12]  Shin Saito,et al.  Introducing game elements in crowdsourced video captioning by non-experts , 2014, W4A.

[13]  W. G. Parrott,et al.  Emotions in social psychology : essential readings , 2001 .

[14]  Serkan Gunal,et al.  A computational morphological lexicon for Turkish: TrLex , 2018 .

[15]  M. Nalls,et al.  Genome-Wide Association Study of Retinopathy in Individuals without Diabetes , 2013, PloS one.

[16]  Cristina Bosco,et al.  Developing Corpora for Sentiment Analysis: The Case of Irony and Senti-TUT , 2013, IEEE Intelligent Systems.

[17]  Harith Alani,et al.  Evaluation Datasets for Twitter Sentiment Analysis: A survey and a new dataset, the STS-Gold , 2013, ESSEM@AI*IA.

[18]  Pablo Gervás,et al.  SentiSense: An easily scalable concept-based affective lexicon for sentiment analysis , 2012, LREC.

[19]  Marco Furini On gamifying the transcription of digital video lectures , 2016, Entertain. Comput..

[20]  Erik Tjong Kim Sang Using Tweets for Assigning Sentiments to Regions , 2014 .

[21]  Dahui Li,et al.  Task Design, Motivation, and Participation in Crowdsourcing Contests , 2011, Int. J. Electron. Commer..

[22]  Laura A. Dabbish,et al.  Designing games with a purpose , 2008, CACM.

[23]  Janne Paavilainen,et al.  Social game studies at CHI 2011 , 2011, CHI EA '11.

[24]  Sanket Sahu,et al.  Twitter Sentiment Analysis -- A More Enhanced Way of Classification and Scoring , 2015, 2015 IEEE International Symposium on Nanoelectronic and Information Systems.

[25]  Christopher M. Danforth,et al.  The Geography of Happiness: Connecting Twitter Sentiment and Expression, Demographics, and Objective Characteristics of Place , 2013, PloS one.

[26]  Marco Furini,et al.  Location privacy and public metadata in social media platforms: attitudes, behaviors and opinions , 2014, Multimedia Tools and Applications.

[27]  Yohei Seki Use of Twitter for Analysis of Public Sentiment for Improvement of Local Government Service , 2016, 2016 IEEE International Conference on Smart Computing (SMARTCOMP).

[28]  P. Ekman An argument for basic emotions , 1992 .

[29]  Yu-Ru Lin,et al.  Assessing Sentiment Segregation in Urban Communities , 2014, SocialCom '14.

[30]  Daniel J. Veit,et al.  More than fun and money. Worker Motivation in Crowdsourcing - A Study on Mechanical Turk , 2011, AMCIS.

[31]  Marco Furini,et al.  Mobile Games: What to expect in the near Future , 2007, GAMEON.

[32]  Michael S. Bernstein,et al.  Empath: Understanding Topic Signals in Large-Scale Text , 2016, CHI.

[33]  R. Plutchik Emotion, a psychoevolutionary synthesis , 1980 .

[34]  Cristina Bosco,et al.  Detecting Happiness in Italian Tweets: Towards an Evaluation Dataset for Sentiment Analysis in Felicittà , 2014 .

[35]  Marco Roccetti,et al.  Realizing the unexploited potential of games on serious challenges , 2010, CIE.

[36]  P. Young,et al.  Emotion and personality , 1963 .

[37]  James W. Ainsworth Why Does It Take a Village? The Mediation of Neighborhood Effects on Educational Achievement , 2002 .

[38]  Quoc V. Le,et al.  Exploiting Similarities among Languages for Machine Translation , 2013, ArXiv.

[39]  Marco Furini Users Behavior in Location-Aware Services: Digital Natives versus Digital Immigrants , 2014, Adv. Hum. Comput. Interact..

[40]  Marco Furini,et al.  ViMood: Using social emotions to improve video indexing , 2015, 2015 12th Annual IEEE Consumer Communications and Networking Conference (CCNC).

[41]  Marco Furini,et al.  On using cashtags to predict companies stock trends , 2017, 2017 14th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[42]  Laura A. Dabbish,et al.  Labeling images with a computer game , 2004, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[43]  Jure Leskovec,et al.  Inducing Domain-Specific Sentiment Lexicons from Unlabeled Corpora , 2016, EMNLP.