What do we mean when we talk about transparency? Towards meaningful transparency in commercial content moderation

This paper seeks to provide greater specificity to demands for transparency in the commercial content moderation practices of digital platforms. We identify gaps in knowledge through a thematic analysis of 380 survey responses from individuals who have been the subject of content moderation decisions. We argue that meaningful transparency should be understood as a component of a communicative process of accountability (rendering account) to independent stakeholders. We make specific recommendations for platforms to provide people with clear information about decisions that affect them, including what content is moderated, which rule was breached, and a description of the people and automated processes responsible for identifying content and making the decision. Beyond providing more information to individuals about particular decisions, however, we note the major challenge of improving understanding of content moderation at a systems level. General demands for greater transparency should be reframed to focus on enhanced access to large-scale disaggregated data that can enable new methods and collaborations between academia, civil society, and journalists to make these systems more understandable and accountable.

[1]  Tarleton Gillespie,et al.  Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions That Shape Social Media , 2018 .

[2]  Axel Bruns,et al.  Easy data, hard data: The politics and pragmatics of Twitter research after the computational turn , 2015 .

[3]  Mike Ananny,et al.  Mike Ananny, Networked Press Freedom: Creating Infrastructures for a Public Right to Hear , 2018, European Journal of Communication.

[4]  J. Braithwaite,et al.  Global Business Regulation , 2001 .

[5]  Brian J. Cook,et al.  Full Disclosure: The Perils and Promise of Transparency , 2007, Perspectives on Politics.

[6]  L. Bankston The Transparency Reporting Toolkit: Best Practices for Reporting on U.S. Government Requests for User Information , 2016 .

[7]  Sabine Himmel Youtube Online Video And Participatory Culture , 2016 .

[8]  Nicolas Suzor,et al.  Evaluating the legitimacy of platform governance: A review of research and a shared research agenda , 2018 .

[9]  J. Fox,et al.  The uncertain relationship between transparency and accountability , 2007 .

[10]  Mehmet Fatih Çömlekçi Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions that Shape Social Media , 2019 .

[11]  Rebecca MacKinnon,et al.  Fostering freedom online: the role of internet intermediaries , 2015 .

[12]  Nicholas Diakopoulos,et al.  Algorithmic Accountability , 2015 .

[13]  Caroline Nolan,et al.  Account Deactivation and Content Removal: Guiding Principles and Practices for Companies and Users , 2011 .

[14]  Mike Ananny,et al.  Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability , 2018, New Media Soc..

[15]  Ariadna Matamoros-Fernández Platformed racism: the mediation and circulation of an Australian race-based controversy on Twitter, Facebook and YouTube , 2017 .

[16]  Michael D Birnhack,et al.  The Invisible Handshake: The Reemergence of the State in the Digital Environment , 2003 .

[17]  Christopher Parsons The (In)effectiveness of Voluntarily Produced Transparency Reports , 2019 .

[18]  Kate Crawford,et al.  What is a flag for? Social media reporting tools and the vocabulary of complaint , 2016, New Media Soc..

[19]  Nicolas Suzor,et al.  The Rule of Law on Instagram: An Evaluation of the Moderation of Images Depicting Women’s Bodies , 2019, University of New South Wales Law Journal.

[20]  S. Noble Algorithms of Oppression: How Search Engines Reinforce Racism , 2018 .

[21]  Sarah T. Roberts Commercial Content Moderation: Digital Laborers' Dirty Work , 2016 .

[22]  Anja Bechmann,et al.  Studying Facebook and Instagram data: The Digital Footprints software , 2015, First Monday.

[23]  Mikkel Flyverbom,et al.  Organizational Transparency: Conceptualizations, Conditions, and Consequences , 2019 .

[24]  James W. Losey Surveillance of Communications: A Legitimization Crisis and the Need for Transparency , 2015 .