Predicting tweet impact using a novel evidential reasoning prediction method

Abstract This study presents a novel evidential reasoning (ER) prediction model called MAKER-RIMER to examine how different features embedded in Twitter posts (tweets) can predict the number of retweets achieved during an electoral campaign. The tweets posted by the two most voted candidates during the official campaign for the 2017 Ecuadorian Presidential election were used for this research. For each tweet, five features including type of tweet, emotion, URL, hashtag, and date are identified and coded to predict if tweets are of either high or low impact. The main contributions of the new proposed model include its suitability to analyse tweet datasets based on likelihood analysis of data. The model is interpretable, and the prediction process relies only on the use of available data. The experimental results show that MAKER-RIMER performed better, in terms of misclassification error, when compared against other predictive machine learning approaches. In addition, the model allows observing which features of the candidates’ tweets are linked to high and low impact. Tweets containing allusions to the contender candidate, either with positive or negative connotations, without hashtags, and written towards the end of the campaign, were persistently those with the highest impact. URLs, on the other hand, is the only variable that performs differently for the two candidates in terms of achieving high impact. MAKER-RIMER can provide campaigners of political parties or candidates with a tool to measure how features of tweets are predictors of their impact, which can be useful to tailor Twitter content during electoral campaigns.

[1]  Davide Ballabio,et al.  Multivariate comparison of classification performance measures , 2017 .

[2]  Jian-Bo Yang,et al.  Data classification using evidence reasoning rule , 2017, Knowl. Based Syst..

[3]  Bin Zhu,et al.  Making sense of organization dynamics using text analysis , 2017, Expert Syst. Appl..

[4]  Jian-Bo Yang,et al.  Solving multiple-criteria R&D project selection problems with a data-driven evidential reasoning rule , 2018, International Journal of Project Management.

[5]  Min Xue,et al.  An evidential reasoning approach based on risk attitude and criterion reliability , 2020, Knowl. Based Syst..

[6]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[7]  Nima Y. Jalali,et al.  Composing tweets to increase retweets , 2019 .

[8]  Gang Chen,et al.  Determinants of users' information dissemination behavior on social networking sites: An elaboration likelihood model perspective , 2018, Internet Res..

[9]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[10]  Jian-Bo Yang,et al.  A Study on Generalising Bayesian Inference to Evidential Reasoning , 2014, Belief Functions.

[11]  Jian-Bo Yang,et al.  Combined medical quality assessment using the evidential reasoning approach , 2015, Expert Syst. Appl..

[13]  Jian-Bo Yang,et al.  Inferential modelling and decision making with data , 2017, 2017 23rd International Conference on Automation and Computing (ICAC).

[14]  Jian-Bo Yang,et al.  A new machine learning technique for predicting traumatic injuries outcomes based on the vital signs , 2019, 2019 25th International Conference on Automation and Computing (ICAC).

[15]  Igor Mozetič,et al.  Stance and influence of Twitter users regarding the Brexit referendum , 2017, Computational social networks.

[16]  Xinping Yan,et al.  Machine learning-based wear fault diagnosis for marine diesel engine by fusing multiple data-driven models , 2020, Knowl. Based Syst..

[17]  Jian-Bo Yang,et al.  Belief rule-base inference methodology using the evidential reasoning Approach-RIMER , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[18]  Sourav Kumar Dandapat,et al.  Forecasting the Future: Leveraging RNN based Feature Concatenation for Tweet Outbreak Prediction , 2020, COMAD/CODS.

[19]  Jian-Bo Yang,et al.  Optimization Models for Training Belief-Rule-Based Systems , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[20]  Swapnil Mishra,et al.  Feature Driven and Point Process Approaches for Popularity Prediction , 2016, CIKM.

[21]  Kang Zhao,et al.  The turf is always greener: Predicting decommitments in college football recruiting using Twitter data , 2019, Decis. Support Syst..

[22]  George Mohler,et al.  Forecasting Retweet Count during Elections Using Graph Convolution Neural Networks , 2018, 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA).

[23]  Sharath Chandra Guntuku,et al.  To Retweet or Not to Retweet: Understanding What Features of Cardiovascular Tweets Influence Their Retransmission , 2018, Journal of health communication.

[24]  Athena Vakali,et al.  Detecting variation of emotions in online activities , 2017, Expert Syst. Appl..

[25]  Jürgen Buder,et al.  Making retweeting social: The influence of content and context information on sharing news in Twitter , 2015, Comput. Hum. Behav..

[26]  J. Grieve,et al.  Stylistic variation on the Donald Trump Twitter account: A linguistic analysis of tweets posted between 2009 and 2018 , 2019, PloS one.

[27]  Jayeon Lee,et al.  The more attacks, the more retweets: Trump’s and Clinton’s agenda setting on Twitter , 2017 .

[28]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[29]  Gang Chen,et al.  Understanding and predicting individual retweeting behavior: Receiver perspectives , 2017, Appl. Soft Comput..

[30]  Xinping Yan,et al.  Use of fuzzy rule-based evidential reasoning approach in the navigational risk assessment of inland waterway transportation systems , 2016 .

[31]  M. Benalla,et al.  Improving Driver Assistance in Intelligent Transportation Systems: An Agent-Based Evidential Reasoning Approach , 2020 .

[32]  Jian-Bo Yang,et al.  Belief rule-based inference for predicting trauma outcome , 2016, Knowl. Based Syst..

[33]  Chuang Wang,et al.  The influence of affective cues on positive emotion in predicting instant information sharing on microblogs: Gender as a moderator , 2017, Inf. Process. Manag..

[34]  Cheng Zhang,et al.  Crowd or Hubs: information diffusion patterns in online social networks in disasters , 2020 .

[35]  Dong-Ling Xu,et al.  Evidential Reasoning Rule-Based Decision Support System for Predicting ICU Admission and In-Hospital Death of Trauma , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[36]  Yogesh Kumar Dwivedi,et al.  Polarization and acculturation in US Election 2016 outcomes – Can twitter analytics predict changes in voting preferences , 2019, Technological Forecasting and Social Change.

[37]  Mostafa Adelizadeh,et al.  Identification the First Priority over Effective Factors in Occurrence of Building Construction Accidents with Employing the Analytical Hierarchy Process Method, and Expert Choice Software , 2018 .

[38]  Jon-Patrick Allem,et al.  The Why We Retweet scale , 2018, PloS one.

[39]  Isabell M. Welpe,et al.  Election Forecasts With Twitter , 2011 .

[40]  Marie-Jeanne Lesot,et al.  Comparison-Based Inverse Classification for Interpretability in Machine Learning , 2018, IPMU.

[41]  A. Prakash,et al.  Recovering from Scandals: Twitter Coverage of Oxfam and Save the Children Scandals , 2020, VOLUNTAS: International Journal of Voluntary and Nonprofit Organizations.

[42]  RudatAnja,et al.  Making retweeting social , 2015 .

[43]  Antonio Moreno,et al.  Which emotional brand values do my followers want to hear about? An investigation of popular European tourist destinations , 2018, J. Inf. Technol. Tour..

[44]  Nicholas Jing Yuan,et al.  Who Will Reply to/Retweet This Tweet?: The Dynamics of Intimacy from Online Social Interactions , 2016, WSDM.

[45]  Jayeon Lee,et al.  Gendered campaign tweets: The cases of Hillary Clinton and Donald Trump , 2016 .

[46]  Ryan L. Boyd,et al.  The Development and Psychometric Properties of LIWC2015 , 2015 .

[47]  Farzana Masroor,et al.  Polarization and Ideological Weaving in Twitter Discourse of Politicians , 2019, Social Media + Society.

[48]  Jiebo Luo,et al.  Catching Fire via "Likes": Inferring Topic Preferences of Trump Followers on Twitter , 2016, ICWSM.

[49]  E. Pancer,et al.  The popularity and virality of political social media: hashtags, mentions, and links predict likes and retweets of 2016 U.S. presidential nominees’ tweets , 2016 .

[50]  H. López-González,et al.  Government Formation and Political Discussions in Twitter: An Extended Model for Quantifying Political Distances in Multiparty Democracies , 2019 .

[51]  Shaojie Tang,et al.  Popularity Prediction for Single Tweet Based on Heterogeneous Bass Model , 2021, IEEE Transactions on Knowledge and Data Engineering.

[52]  Cong Xu,et al.  Application of Evidential Reasoning rules to identification of asthma control steps in children , 2016, 2016 22nd International Conference on Automation and Computing (ICAC).

[53]  D. Trilling,et al.  From Newsworthiness to Shareworthiness , 2017 .

[54]  Xuanjing Huang,et al.  Hot Topic-Aware Retweet Prediction with Masked Self-attentive Model , 2019, SIGIR.

[55]  Paolo Nesi,et al.  Assessing the reTweet proneness of tweets: predictive models for retweeting , 2018, Multimedia Tools and Applications.

[56]  A. S. Ananda,et al.  What makes fashion consumers “click”? Generation of eWoM engagement in social media , 2019, Asia Pacific Journal of Marketing and Logistics.

[57]  Walid Magdy,et al.  Trump vs. Hillary: What Went Viral During the 2016 US Presidential Election , 2017, SocInfo.

[58]  G. Enli Twitter as arena for the authentic outsider: exploring the social media campaigns of Trump and Clinton in the 2016 US presidential election , 2017 .

[59]  Jeong Yeob Han,et al.  Predicting Retweeting Behavior on Breast Cancer Social Networks: Network and Content Characteristics , 2016, Journal of health communication.

[60]  Mehul Barot,et al.  Trend Analysis on Twitter for Predicting Public Opinion on Ongoing Events , 2018 .

[61]  Amr Ahmed,et al.  Conditional Generative Adversarial Networks for Data Augmentation in Breast Cancer Classification , 2020, SCDM.

[62]  Kurt Hornik,et al.  Misc Functions of the Department of Statistics, ProbabilityTheory Group (Formerly: E1071), TU Wien , 2015 .

[63]  Walid Magdy,et al.  UK General Election 2017: a Twitter Analysis , 2017, ArXiv.

[64]  Katia Sycara,et al.  Event Outcome Prediction using Sentiment Analysis and Crowd Wisdom in Microblog Feeds , 2019, ArXiv.

[65]  Emma K. Macdonald,et al.  Antecedents of Retweeting in a (Political) Marketing Context , 2017 .

[66]  David Cornforth,et al.  Ranking of high-value social audiences on Twitter , 2016, Decis. Support Syst..

[67]  Bernardete Ribeiro,et al.  Retweet Predictive Model for Predicting the Popularity of Tweets , 2018, SoCPaR.

[68]  K O LeeMatthew,et al.  The influence of affective cues on positive emotion in predicting instant information sharing on microblogs , 2017 .

[69]  XuDong-Ling,et al.  Data classification using evidence reasoning rule , 2017 .

[70]  Dong-Ling Xu,et al.  Evidential reasoning rule for evidence combination , 2013, Artif. Intell..

[71]  Konstantin E. Samouylov,et al.  Carrying out consensual Group Decision Making processes under social networks using sentiment analysis over comparative expressions , 2019, Knowl. Based Syst..

[72]  Cynthia Rudin,et al.  Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead , 2018, Nature Machine Intelligence.

[73]  Gerardo I. Simari,et al.  Predicting user reactions to Twitter feed content based on personality type and social cues , 2020, Future Gener. Comput. Syst..

[74]  Jian-Bo Yang,et al.  Inference analysis and adaptive training for belief rule based systems , 2011, Expert Syst. Appl..

[75]  Yuko Murayama,et al.  Why I Retweet? Exploring User's Perspective on Decision-Making of Information Spreading during Disasters , 2017, HICSS.

[76]  Brian D. Ripley,et al.  Modern applied statistics with S, 4th Edition , 2002, Statistics and computing.

[77]  E. Thorson,et al.  The twitterization of journalism: User perceptions of news tweets , 2020 .

[78]  Glen J. Weiss,et al.  Discordant financial conflicts of interest disclosures between clinical trial conference abstract and subsequent publication , 2019, PeerJ.

[79]  Itai Himelboim,et al.  Important tweets matter: Predicting retweets in the #BlackLivesMatter talk on twitter , 2018, Comput. Hum. Behav..

[80]  R. Manmatha,et al.  Predicting retweet count using visual cues , 2013, CIKM.

[81]  Arthur P. Dempster,et al.  Upper and Lower Probabilities Induced by a Multivalued Mapping , 1967, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[82]  William N. Venables,et al.  Modern Applied Statistics with S , 2010 .

[83]  Suzan Burton,et al.  ‘Retweet for a Chance to…’: an analysis of what triggers consumers to engage in seeded eWOM on Twitter , 2017 .