Hidden resilience and adaptive dynamics of the global online hate ecology

Online hate and extremist narratives have been linked to abhorrent real-world events, including a current surge in hate crimes1–6 and an alarming increase in youth suicides that result from social media vitriol7; inciting mass shootings such as the 2019 attack in Christchurch, stabbings and bombings8–11; recruitment of extremists12–16, including entrapment and sex-trafficking of girls as fighter brides17; threats against public figures, including the 2019 verbal attack against an anti-Brexit politician, and hybrid (racist–anti-women–anti-immigrant) hate threats against a US member of the British royal family18; and renewed anti-western hate in the 2019 post-ISIS landscape associated with support for Osama Bin Laden’s son and Al Qaeda. Social media platforms seem to be losing the battle against online hate19,20 and urgently need new insights. Here we show that the key to understanding the resilience of online hate lies in its global network-of-network dynamics. Interconnected hate clusters form global ‘hate highways’ that—assisted by collective online adaptations—cross social media platforms, sometimes using ‘back doors’ even after being banned, as well as jumping between countries, continents and languages. Our mathematical model predicts that policing within a single platform (such as Facebook) can make matters worse, and will eventually generate global ‘dark pools’ in which online hate will flourish. We observe the current hate network rapidly rewiring and self-repairing at the micro level when attacked, in a way that mimics the formation of covalent bonds in chemistry. This understanding enables us to propose a policy matrix that can help to defeat online hate, classified by the preferred (or legally allowed) granularity of the intervention and top-down versus bottom-up nature. We provide quantitative assessments for the effects of each intervention. This policy matrix also offers a tool for tackling a broader class of illicit online behaviours21,22 such as financial fraud.The dynamics of interactions between hate-orientated networks on different online platforms is characterized, and a mathematical model predicts that policing on one online platform can make matters worse and generate ‘darker’ parts of the Internet.

[1]  Sophie Wood,et al.  Self-Harm, Suicidal Behaviours, and Cyberbullying in Children and Young People: Systematic Review , 2018, Journal of medical Internet research.

[2]  Maura Conway,et al.  Terrorist Use of the Internet by the Numbers: Quantifying Behaviors, Patterns and Processes , 2017 .

[3]  H. Stanley,et al.  Vulnerability of network of networks , 2014 .

[4]  E. Mohammadi,et al.  Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[5]  H. Stanley,et al.  Introduction to Phase Transitions and Critical Phenomena , 1972 .

[6]  H. Stanley,et al.  Phase Transitions and Critical Phenomena , 2008 .

[7]  John Horgan,et al.  Bombing Alone: Tracing the Motivations and Antecedent Behaviors of Lone-Actor Terrorists*,†,‡ , 2013, Journal of forensic sciences.

[8]  Y. Vorobyeva,et al.  New online ecology of adversarial aggregates: ISIS and beyond , 2016, Science.

[9]  P. Gill.  Who are the lone- actor terrorists? , 2015 .

[10]  P. Gill,et al.  End of the Lone Wolf: The Typology that Should Not Have Been , 2017 .

[11]  A. Barabasi,et al.  Quantifying social group evolution , 2007, Nature.

[12]  D. Lazer,et al.  Fake news on Twitter during the 2016 U.S. presidential election , 2019, Science.

[13]  Neil F Johnson,et al.  Interplay between function and structure in complex networks. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  Peter Hedström,et al.  Mesolevel Networks and the Diffusion of Social Movements: The Case of the Swedish Social Democratic Party1 , 2000, American Journal of Sociology.