“I’ll be back”: Examining Restored Accounts On Twitter

Online social networks like Twitter actively monitor their platform to identify accounts that go against their rules. Twitter enforces account level moderation, i.e. suspension of a Twitter account in severe cases of platform abuse. A point of note is that these suspensions are sometimes temporary and even incorrect. Twitter provides a redressal mechanism to ‘restore’ suspended accounts. We refer to all suspended accounts who later have their suspension reversed as ‘restored accounts’. In this paper, we release the firstever dataset and methodology 1 to identify restored accounts. We inspect account properties and tweets of these restored accounts to get key insights into the effects of suspension. We build a prediction model to classify an account into normal, suspended or restored. We use SHAP values to interpret this model and identify important features. SHAP (SHapley Additive exPlanations) is a method to explain individual predictions. We show that profile features like date of account creation and the ratio of retweets to total tweets are more important than content-based features like sentiment scores and Ekman emotion scores when it comes to classification of an account as normal, suspended or restored. We investigate restored accounts further in the pre-suspension and post-restoration phases. We see that the number of tweets per account drop by 53.95% in the post-restoration phase, signifying less ‘spammy’ behaviour after reversal of suspension. However, there was no substantial difference in the content of the tweets posted in the pre-suspension and post-restoration phases.

[1]  Atsuto Maki,et al.  A systematic study of the class imbalance problem in convolutional neural networks , 2017, Neural Networks.

[2]  Jeffrey W. Howard,et al.  Free Speech and Hate Speech , 2019, Annual Review of Political Science.

[3]  Gianluca Stringhini,et al.  Do Platform Migrations Compromise Content Moderation? Evidence from r/The_Donald and r/Incels , 2020, Proc. ACM Hum. Comput. Interact..

[4]  E. Zhuravskaya,et al.  Political Effects of the Internet and Social Media , 2019, Annual Review of Economics.

[5]  Eréndira Rendón Lara,et al.  Addressing the Big Data Multi-class Imbalance Problem with Oversampling and Deep Learning Neural Networks , 2019, IbPRIA.

[6]  Claudio Castellano,et al.  Defining and identifying communities in networks. , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Padmini Srinivasan,et al.  A Postmortem of Suspended Twitter Accounts in the 2016 U.S. Presidential Election , 2019, 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[8]  Dawn Xiaodong Song,et al.  Suspended accounts in retrospect: an analysis of twitter spam , 2011, IMC '11.

[9]  Yogesh Kumar Dwivedi,et al.  Advances in Social Media Research: Past, Present and Future , 2017, Information Systems Frontiers.

[10]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[11]  Svitlana Volkova,et al.  Identifying Effective Signals to Predict Deleted and Suspended Accounts on Twitter Across Languages , 2017, ICWSM.

[12]  Stan Matwin,et al.  Addressing the Curse of Imbalanced Training Sets: One-Sided Selection , 1997, ICML.

[13]  Jane You,et al.  Hybrid Classifier Ensemble for Imbalanced Data , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[15]  Erik Schultes,et al.  The FAIR Guiding Principles for scientific data management and stewardship , 2016, Scientific Data.

[16]  Jacob Eisenstein,et al.  You Can't Stay Here , 2017, Proc. ACM Hum. Comput. Interact..

[17]  Janez Demšar,et al.  Emotion Recognition on Twitter: Comparative Study and Training a Unison Model , 2020, IEEE Transactions on Affective Computing.

[18]  Abdullah Mueen,et al.  BotCamp: Bot-driven Interactions in Social Campaigns , 2019, WWW.

[19]  Andreas Jungherr Twitter use in election campaigns: A systematic literature review , 2016 .

[20]  L. Shapley A Value for n-person Games , 1988 .

[21]  Abdullah Mueen,et al.  On Twitter Purge: A Retrospective Analysis of Suspended Users , 2020, WWW.

[22]  P. Ekman An argument for basic emotions , 1992 .

[23]  Vincent A. Traag,et al.  From Louvain to Leiden: guaranteeing well-connected communities , 2018, Scientific Reports.

[24]  Eric Gilbert,et al.  VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text , 2014, ICWSM.