Moral intuitions behind deepfake-related discussions in Reddit communities

Deepfakes are AI-synthesized content that are becoming popular on many social media platforms, meaning the use of deepfakes is increasing in society, regardless of its societal implications. Its implications are harmful if the moral intuitions behind deepfakes are problematic; thus, it is important to explore how the moral intuitions behind deepfakes unfold in communities at scale. However, understanding perceived moral viewpoints unfolding in digital contexts is challenging, due to the complexities in conversations. In this research, we demonstrate how Moral Foundations Theory (MFT) can be used as a lens through which to operationalize moral viewpoints in discussions about deepfakes on Reddit communities. Using the extended Moral Foundations Dictionary (eMFD), we measured the strengths of moral intuition (moral loading) behind 101,869 Reddit posts. We present the discussions that unfolded on Reddit in 2018 to 2022 wherein intuitions behind some posts were found to be morally questionable to society. Our results may help platforms detect and take action against immoral activities related to deepfakes.

[1]  Tim Weninger,et al.  Analysis of Moral Judgment on Reddit , 2023, IEEE Transactions on Computational Social Systems.

[2]  B. Sloot,et al.  Deepfakes: regulatory challenges for the synthetic society , 2022, Comput. Law Secur. Rev..

[3]  Michael S. Bernstein,et al.  Measuring the Prevalence of Anti-Social Behavior in Online Communities , 2022, Proc. ACM Hum. Comput. Interact..

[4]  Kweilin T. Lucas.  Deepfakes and Domestic Violence: Perpetrating Intimate Partner Abuse Using Video Technology , 2022, Victims & Offenders.

[5]  C. Rosé,et al.  A Tale of Two Subreddits: Measuring the Impacts of Quarantines on Political Engagement on Reddit , 2022, International Conference on Web and Social Media.

[6]  Munindar P. Singh,et al.  Moral and social ramifications of autonomous vehicles: a qualitative study of the perceptions of professional drivers , 2022, Behav. Inf. Technol..

[7]  L. Nacke,et al.  “I Don’t Want To Shoot The Android”: Players Translate Real-Life Moral Intuitions to In-Game Decisions in Detroit: Become Human , 2022, CHI.

[8]  Mark E. Whiting,et al.  Are Deepfakes Concerning? Analyzing Conversations of Deepfakes on Reddit and Exploring Societal Implications , 2022, CHI.

[9]  Fareed Zaffar,et al.  Are Proactive Interventions for Reddit Communities Feasible? , 2021, ICWSM.

[10]  Rishemjit Kaur,et al.  Morality-Based Assertion and Homophily on Social Media: A Cultural Comparison Between English and Japanese Languages , 2021, Frontiers in Psychology.

[11]  C. V. D. Weele,et al.  The farmers’ dilemma: Meat, means, and morality , 2021, Appetite.

[12]  A. de Ruiter.  The Distinct Wrong of Deepfakes , 2021, Philosophy & Technology.

[13]  Karin Wahl-Jorgensen,et al.  Conjecturing Fearful Futures: Journalistic Discourses on Deepfakes , 2021 .

[14]  J. P. Pérez Dasilva,et al.  Deepfakes on Twitter: Which Actors Control Their Spread? , 2021, Media and Communication.

[15]  Robin Blom,et al.  To Believe or Not to Believe: Framing Analysis of Content and Audience Response of Top 10 Deepfake Videos on YouTube , 2021, Cyberpsychology Behav. Soc. Netw..

[16]  Catherine Francis Brooks,et al.  Popular Discourse Around Deepfakes and the Interdisciplinary Challenge of Fake Video Distribution , 2021, Cyberpsychology Behav. Soc. Netw..

[17]  Matthew B. Kugler,et al.  Deepfake Privacy: Attitudes and Regulation , 2021, SSRN Electronic Journal.

[18]  Simon Copland,et al.  Reddit quarantined: can changing platform affordances reduce hateful material online? , 2020, Internet Policy Rev..

[19]  A. Bruckman,et al.  Quarantined! Examining the Effects of a Community-Wide Moderation Intervention on Reddit , 2020, ACM Trans. Comput. Hum. Interact..

[20]  Claes H. de Vreese,et al.  Do (Microtargeted) Deepfakes Have Real Effects on Political Attitudes? , 2020, The International Journal of Press/Politics.

[21]  Jacob T. Fisher,et al.  The extended Moral Foundations Dictionary (eMFD): Development and applications of a crowd-sourced approach to extracting moral intuitions from text , 2020, Behavior Research Methods.

[22]  Emily van der Nagel.  Verifying images: deepfakes, control, and consent , 2020 .

[23]  Ron Tamborini,et al.  Advancing the Model of Intuitive Morality and Exemplars , 2020 .

[24]  Nasir Memon,et al.  Effects of Credibility Indicators on Social Media News Sharing Intent , 2020, CHI.

[25]  Andrei O. J. Kwok,et al.  Deepfake: a social construction of technology perspective , 2020, Current Issues in Tourism.

[26]  Carl Öhman,et al.  Introducing the pervert’s dilemma: a contribution to the critique of Deepfake Pornography , 2019, Ethics and Information Technology.

[27]  Eshwar Chandrasekharan,et al.  Crossmod: A Cross-Community Learning-based System to Assist Reddit Moderators , 2019, Proc. ACM Hum. Comput. Interact..

[28]  Saeid Nahavandi,et al.  Deep learning for deepfakes creation and detection: A survey , 2019, Comput. Vis. Image Underst..

[29]  P. Hegarty,et al.  How does culture shape our moral identity? Moral foundations in Saudi Arabia and Britain , 2019, European Journal of Social Psychology.

[30]  Jeffrey Westling.  Are Deep Fakes a Shallow Concern? A Critical Analysis of the Likely Societal Reaction to Deep Fakes , 2019 .

[31]  Harith Alani,et al.  Exploring Misogyny across the Manosphere in Reddit , 2019, WebSci.

[32]  Jana Diesner,et al.  Enhancing the Measurement of Social Effects by Capturing Morality , 2019, WASSA@NAACL-HLT.

[33]  Kyriaki Kalimeri,et al.  Human Values and Attitudes towards Vaccination in Social Media , 2019, WWW.

[34]  J. Fletcher.  Deepfakes, Artificial Intelligence, and Some Kind of Dystopia: The New Faces of Online Post-Fact Performance , 2019 .

[35]  T. Vaughan,et al.  Applying Moral Foundations Theory to the Explanation of Capital Jurors’ Sentencing Decisions , 2019, Justice Quarterly.

[36]  Morteza Dehghani,et al.  Moralization in social networks and the emergence of violence during protests , 2018, Nature Human Behaviour.

[37]  Joshua May.  Regard for Reason in the Moral Mind , 2018, Oxford Scholarship Online.

[38]  Munmun De Choudhury,et al.  Mental Health Support and its Relationship to Linguistic Accommodation in Online Communities , 2018, CHI.

[39]  Lindsay S. Hahn,et al.  Extracting Latent Moral Information from Text Narratives: Relevance, Challenges, and Solutions , 2018 .

[40]  Morteza Dehghani,et al.  Dictionaries and distributions: Combining expert knowledge and large scale textual data content analysis , 2018, Behavior research methods.

[41]  David G. Rand,et al.  Do the Right Thing: Experimental Evidence that Preferences for Moral Behavior, Rather Than Equity or Efficiency per se, Drive Human Prosociality , 2018, Judgment and Decision Making.

[42]  Kala J. Melchiori,et al.  Association of moral values with vaccine hesitancy , 2017, Nature Human Behaviour.

[43]  Eric Gilbert,et al.  The Bag of Communities: Identifying Abusive Behavior Online with Preexisting Internet Data , 2017, CHI.

[44]  Adrienne Massanari,et al.  #Gamergate and The Fappening: How Reddit’s algorithm, governance, and culture support toxic technocultures , 2017, New Media Soc..

[45]  I. Filip,et al.  Morality and Ethical Theories in the Context of Human Behavior , 2016 .

[46]  Fabian Flöck,et al.  Evolution of reddit: from the front page of the internet to a self-referential community? , 2014, WWW.

[47]  Peter H. Ditto,et al.  Moral Foundations Theory: The Pragmatic Validity of Moral Pluralism , 2012 .

[48]  Nicky Lewis,et al.  Mirrored Morality: An Exploration of Moral Choice in Video Games , 2012, Cyberpsychology Behav. Soc. Netw..

[49]  G. Tyson,et al.  Will Morality or Political Ideology Determine Attitudes to Climate Change , 2012 .

[50]  Brian A. Nosek,et al.  Mapping the moral domain. , 2011, Journal of personality and social psychology.

[51]  Dacher Keltner,et al.  Emotions as Moral Amplifiers: An Appraisal Tendency Approach to the Influences of Distinct Emotions upon Moral Judgment , 2011 .

[52]  L. Skitka,et al.  Moral and Religious Convictions and Intentions to Vote in the 2008 Presidential Election , 2010 .

[53]  Kurt Gray,et al.  Moral typecasting: divergent perceptions of moral agents and moral patients. , 2009, Journal of personality and social psychology.

[54]  P. Richerson,et al.  Punishment allows the evolution of cooperation (or anything else) in sizable groups , 1992 .

[55]  P. Lifton,et al.  Individual differences in moral development: the relation of sex, gender, and personality to morality. , 1985, Journal of personality.

[56]  Anupama Chadha,et al.  Deepfake: An Overview , 2021 .

[57]  Dilrukshi Gamage,et al.  The Emergence of Deepfakes and its Societal Implications: A Systematic Review , 2021, TTO.

[58]  Konstantin A. Pantserev,et al.  The Malicious Use of AI-Based Deepfake Technology as the New Threat to Psychological Security and Political Stability , 2020 .

[59]  Mehmet Fatih Çömlekçi.  Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions that Shape Social Media , 2019 .

[60]  Cliff Lampe,et al.  The Internet's Hidden Rules , 2018, Proc. ACM Hum. Comput. Interact..