Coordination and Collaboration: How do Volunteer Moderators Work as a Team in Live Streaming Communities?

Volunteer moderators (mods) play significant roles in developing moderation standards and dealing with harmful content in their micro-communities. However, little work explores how volunteer mods work as a team. In line with prior work about understanding volunteer moderation, we interview 40 volunteer mods on Twitch — a leading live streaming platform. We identify how mods collaborate on tasks (off-streaming coordination and preparation, in-stream real-time collaboration, and relationship building both off-stream and in-stream to reinforce collaboration) and how mods contribute to moderation standards (collaboratively working on the community rulebook and individually shaping community norms). We uncover how volunteer mods work as an effective team. We also discuss how the affordances of multi-modal communication and informality of volunteer moderation contribute to task collaboration, standards development, and mod’s roles and responsibilities.

[1]  Geoff F. Kaufman,et al.  Metaphors in moderation , 2020, New Media Soc..

[2]  Donghee Yvette Wohn,et al.  After Violation But Before Sanction: Understanding Volunteer Moderators' Profiling Processes Toward Violators in Live Streaming Communities , 2021, Proc. ACM Hum. Comput. Interact..

[3]  Donghee Yvette Wohn,et al.  Conceptualizing Visual Analytic Interventions for Content Moderation , 2021, 2021 IEEE Visualization Conference (VIS).

[4]  Krithika Jagannath,et al.  Designing for Youth-Centered Moderation and Community Governance in Minecraft , 2021, ACM Trans. Comput. Hum. Interact..

[5]  Donghee Yvette Wohn,et al.  Moderation Visibility: Mapping the Strategies of Volunteer Moderators in Live Streaming Micro Communities , 2021, IMX.

[6]  Donghee Yvette Wohn,et al.  Harassment Experiences of Women and LGBTQ Live Streamers and How They Handled Negativity , 2021, IMX.

[7]  Donghee Yvette Wohn,et al.  Understanding Rules in Live Streaming Micro Communities on Twitch , 2021, IMX.

[8]  Rosta Farzan,et al.  Designing to Stop Live Streaming Cyberbullying: A case study of Twitch Live Streaming Platform , 2021, C&T.

[9]  Yubo Kou,et al.  Flag and Flaggability in Automated Moderation: The Case of Reporting Toxic Behavior in an Online Game Community , 2021, CHI.

[10]  Matthew Lease,et al.  The Psychological Well-Being of Content Moderators: The Emotional Labor of Commercial Moderation and Avenues for Improving Support , 2021, CHI.

[11]  D. Y. Wohn,et al.  After Violation But Before Sanction: Understanding Volunteer Moderators' Profiling Processes Toward Violators in Live Streaming Communities , 2021, Proc. ACM Hum. Comput. Interact..

[12]  D. Y. Wohn,et al.  Categorizing Online Harassment Interventions , 2020, International Symposium on Technology and Society.

[13]  Sarah T. Roberts,et al.  Expanding the debate about content moderation: Scholarly research agendas for the coming policy debates , 2020, Internet Policy Rev..

[14]  Tarleton Gillespie,et al.  Content moderation, AI, and the question of scale , 2020, Big Data Soc..

[15]  Donghee Yvette Wohn,et al.  Audience Management Practices of Live Streamers on Twitch , 2020, IMX.

[16]  Sarah A. Gilbert,et al.  "I run the world's largest historical outreach project and it's on a cesspool of a website." Moderating a Public Scholarship Site on Reddit: A Case Study of r/AskHistorians , 2020, Proc. ACM Hum. Comput. Interact..

[17]  Sarah Gilbert,et al.  “I run the world’s largest historical outreach project and it’s on a cesspool of a website.” Moderating a public scholarship site on Reddit: A case study of r/AskHistorians , 2020 .

[18]  Sonali Tandon,et al.  Synthesized Social Signals: Computationally-Derived Social Signals from Account Histories , 2020, CHI.

[19]  Amy Bruckman,et al.  "Did You Suspect the Post Would be Removed?" , 2019, Proc. ACM Hum. Comput. Interact..

[20]  Casey Fiesler,et al.  Moderation Challenges in Voice-based Online Communities on Discord , 2019, Proc. ACM Hum. Comput. Interact..

[21]  Amy Bruckman,et al.  Does Transparency in Moderation Really Matter? , 2019, Proc. ACM Hum. Comput. Interact..

[22]  Cristian Danescu-Niculescu-Mizil,et al.  Content Removal as a Moderation Strategy , 2019, Proc. ACM Hum. Comput. Interact..

[23]  Bryan C. Semaan,et al.  Moderation Practices as Emotional Labor in Sustaining Online Communities: The Case of AAPI Identity Work on Reddit , 2019, CHI.

[24]  Donghee Yvette Wohn,et al.  Volunteer Moderators in Twitch Micro Communities: How They Get Involved, the Roles They Play, and the Emotional Labor They Experience , 2019, CHI.

[25]  J. Nathan Matias,et al.  The Civic Labor of Volunteer Moderators Online , 2019, Social Media + Society.

[26]  Geoff Kaufman,et al.  Moderator engagement and community development in the age of algorithms , 2019, New Media Soc..

[27]  Mehmet Fatih Çömlekçi Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions that Shape Social Media , 2019 .

[28]  A. Bruckman,et al.  Human-Machine Collaboration for Content Regulation: The Case of Reddit Automoderator , 2019, ACM Trans. Comput. Hum. Interact..

[29]  Eric Gilbert,et al.  The Internet's Hidden Rules , 2018, Proceedings of the ACM on Human-Computer Interaction.

[30]  Casey Fiesler,et al.  Reddit Rules! Characterizing an Ecosystem of Governance , 2018, ICWSM.

[31]  Sarah Myers West,et al.  Censored, suspended, shadowbanned: User interpretations of content moderation on social media platforms , 2018, New Media Soc..

[32]  Donghee Yvette Wohn,et al.  Explaining Viewers' Emotional, Instrumental, and Financial Support Provision for Live Streamers , 2018, CHI.

[33]  Munmun De Choudhury,et al.  Norms Matter: Contrasting Social Support Around Behavior Change in Online Weight Loss Communities , 2018, CHI.

[34]  Cliff Lampe,et al.  The Internet's Hidden Rules , 2018, Proc. ACM Hum. Comput. Interact..

[35]  Donghee Yvette Wohn,et al.  Understanding eSports Team Formation and Coordination , 2017, Computer Supported Cooperative Work (CSCW).

[36]  Eric Gilbert,et al.  The Bag of Communities: Identifying Abusive Behavior Online with Preexisting Internet Data , 2017, CHI.

[37]  Robert E. Kraut,et al.  Shaping Pro and Anti-Social Behavior on Twitch Through Moderation and Example-Setting , 2017, CSCW.

[38]  C. Whelan Managing dynamic security networks: Towards the strategic managing of cooperation, coordination and collaboration , 2017 .

[39]  Jean-Gregoire Bernard,et al.  Controlling Bad Behavior in Online Communities: An Examination of Moderation Work , 2020, ICIS.

[40]  Marcin Sydow,et al.  Diversity of editors and teams versus quality of cooperative work: experiments on wikipedia , 2017, Journal of Intelligent Information Systems.

[41]  Adam N. Joinson,et al.  Team dynamics in virtual, partially distributed teams: Optimal role fulfillment , 2016, Comput. Hum. Behav..

[42]  Brian Keegan,et al.  Ping to Win?: Non-Verbal Communication and Team Performance in Competitive Online Multiplayer Games , 2016, CHI.

[43]  Safiya Umoja Noble,et al.  The Intersectional Internet: Race, Sex, Class, and Culture Online , 2016 .

[44]  Sarah T. Roberts Commercial Content Moderation: Digital Laborers' Dirty Work , 2016 .

[45]  James Grimmelmann,et al.  The Virtues of Moderation , 2015 .

[46]  Finn Årup Nielsen,et al.  “The sum of all human knowledge”: A systematic review of scholarly research on the content of Wikipedia , 2015, J. Assoc. Inf. Sci. Technol..

[47]  Stina Matthiesen,et al.  Does Distance Still Matter? Revisiting the CSCW Fundamentals on Distributed Collaboration , 2014, TCHI.

[48]  Andruid Kerne,et al.  Streaming on twitch: fostering participatory communities of play within live mixed media , 2014, CHI.

[49]  Robert E. Kraut,et al.  The role of founders in building online groups , 2014, CSCW.

[50]  James D. Herbsleb,et al.  Work-to-rule: the emergence of algorithmic governance in Wikipedia , 2013, C&T '13.

[51]  Kris M. Markman A Networked Self: Identity, Community and Culture on Social Network Sites , 2012, New Media Soc..

[52]  Stefan Larsson,et al.  Law, norms, piracy and online anonymity: Practices of de‐identification in the global file sharing community , 2012 .

[53]  Claire Cardie,et al.  Facilitative moderation for online participation in eRulemaking , 2012, dg.o '12.

[54]  Robert E. Kraut,et al.  Communication and commitment in an online game team , 2012, CHI.

[55]  Hannah Limerick Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems , 2012, International Conference on Human Factors in Computing Systems.

[56]  Oded Nov,et al.  Information Quality in Wikipedia: The Effects of Group Composition and Task Conflict , 2011, J. Manag. Inf. Syst..

[57]  Anita L. Blanchard,et al.  A MODEL OF ONLINE TRUST , 2011 .

[58]  Tao Zhou,et al.  Understanding Online Community User Participation: A Social Influence Perspective , 2011, Internet Res..

[59]  Kathleen M. Swigger,et al.  Online collaboration: Collaborative behavior patterns and factors affecting globally distributed team performance , 2011, Comput. Hum. Behav..

[60]  F. Carré Formal and Informal Work: The Hidden Work Regime in Europe , 2010 .

[61]  Aniket Kittur,et al.  Beyond Wikipedia: coordination and conflict in online production groups , 2010, CSCW '10.

[62]  Ojelanki K. Ngwenyama,et al.  Virtual team collaboration: building shared meaning, resolving breakdowns and creating translucence , 2009, Inf. Syst. J..

[63]  Aniket Kittur,et al.  Harnessing the wisdom of crowds in wikipedia: quality through coordination , 2008, CSCW.

[64]  Carl Gutwin,et al.  Supporting Informal Collaboration in Shared-Workspace Groupware , 2008, J. Univers. Comput. Sci..

[65]  C. Gibson,et al.  Team Implicit Coordination Processes: A Team Knowledge–Based Approach , 2008 .

[66]  Aniket Kittur,et al.  He says, she says: conflict and coordination in Wikipedia , 2007, CHI.

[67]  R. Keast,et al.  Getting The Right Mix: Unpacking Integration Meanings and Strategies , 2007 .

[68]  M. Hogg,et al.  Social Identity, Self-Categorization, and the Communication of Group Norms , 2006 .

[69]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[70]  Rolf T. Wigand,et al.  ICT Enabled Virtual Collaboration through Trust , 2006, J. Comput. Mediat. Commun..

[71]  E. Entin,et al.  Communication overhead: The hidden cost of team cognition. , 2004 .

[72]  Judith S. Olson,et al.  Distance Matters , 2000, Hum. Comput. Interact..

[73]  R. Cialdini,et al.  Social influence: Social norms, conformity and compliance. , 1998 .

[74]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[75]  John C. Tang,et al.  Liveboard: a large interactive display supporting group meetings, presentations, and remote collaboration , 1992, CHI.

[76]  Hideaki Kuzuoka,et al.  Spatial workspace collaboration: a SharedView video support system for remote collaboration capability , 1992, CHI.

[77]  Carl A. Kallgren,et al.  A Focus Theory of Normative Conduct: A Theoretical Refinement and Reevaluation of the Role of Norms in Human Behavior , 1991 .