Arguments about deletion: how experience improves the acceptability of arguments in ad-hoc online task groups

Increasingly, ad-hoc online task groups must make decisions about jointly created artifacts such as open source software and Wikipedia articles. Time-consuming and laborious attention to textual discussions is needed to make such decisions, for which computer support would be beneficial. Yet there has been little study of the argumentation patterns that distributed ad-hoc online task groups use in evaluation and decision-making. In a corpus of English Wikipedia deletion discussions, we investigate the argumentation schemes used, the role of the arguer's experience, and which arguments are acceptable to the audience. We report three main results: First, the most prevalent patterns are the Rules and Evidence schemes from Walton's catalog of argumentation schemes [33], which comprise 36% of arguments. Second, we find that familiarity with community norms correlates with the novices' ability to craft persuasive arguments. Third, acceptable arguments use community-appropriate rhetoric that demonstrate knowledge of policies and community values while problematic arguments are based on personal preference and inappropriate analogy to other cases.

[1]  John M. Carroll,et al.  Learning to use a word processor: by doing, by thinking, and by knowing , 1984 .

[2]  W. Buxton Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[3]  D. Walton Argumentation Schemes for Presumptive Reasoning , 1995 .

[4]  Shelly Farnham,et al.  Structured online interactions: improving the decision-making of small discussion groups , 2000, CSCW '00.

[5]  Jk Joel Katzav,et al.  Argument research corpus , 2004 .

[6]  Ingrid Mulder,et al.  Virtual Teams and the Appropriation of Communication Technology: Exploring the Concept of Media Stickiness , 2003, Computer Supported Cooperative Work (CSCW).

[7]  Susan C. Herring,et al.  Collaborative Authoring on the Web: A Genre Analysis of Online Encyclopedias , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[8]  Amy Bruckman,et al.  Becoming Wikipedian: transformation of participation in a collaborative online encyclopedia , 2005, GROUP.

[9]  Daniel R. Ilgen,et al.  Enhancing the Effectiveness of Work Groups and Teams , 2006, Psychological science in the public interest : a journal of the American Psychological Society.

[10]  Kevin Crowston,et al.  Self-organization of teams for free/libre open source software development , 2007, Inf. Softw. Technol..

[11]  Chris Reed,et al.  Argumentation Schemes , 2008 .

[12]  Iyad Rahwan,et al.  Mass argumentation and the semantic web , 2008, J. Web Semant..

[13]  Brian S. Butler,et al.  Don't look now, but we've created a bureaucracy: the nature and roles of policies and rules in wikipedia , 2008, CHI.

[14]  John Riedl,et al.  Is Wikipedia growing a longer tail? , 2009, GROUP.

[15]  Françoise Détienne,et al.  Participation in online interaction spaces: Design-use mediation in an Open Source Software community , 2009 .

[16]  Amy Bruckman,et al.  Decentralization in Wikipedia Governance , 2009, J. Manag. Inf. Syst..

[17]  Ed H. Chi,et al.  The singularity is not near: slowing growth of Wikipedia , 2009, Int. Sym. Wikis.

[18]  D. Meyer,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S6 References Evidence for a Collective Intelligence Factor in the Performance of Human Groups , 2022 .

[19]  Coye Cheshire,et al.  Readers are not free-riders: reading as a form of participation on wikipedia , 2010, CSCW '10.

[20]  Leon Adam Watts,et al.  Understanding dispute resolution online: using text to reflect personal and substantive issues in conflict , 2010, CHI.

[21]  Robert E. Kraut,et al.  Socialization tactics in wikipedia and their effects , 2010, CSCW '10.

[22]  R. Kraut,et al.  Dealing with Newcomers , 2010 .

[23]  John Riedl,et al.  The effects of group composition on decision quality in a social production community , 2010, GROUP '10.

[24]  Jacob O. Wobbrock,et al.  Understanding Expressions of Unwanted Behaviors in Open Bug Reporting , 2010, 2010 IEEE Symposium on Visual Languages and Human-Centric Computing.

[25]  Brian S. Butler,et al.  Handling flammable materials: Wikipedia biographies of living persons as contentious objects , 2011, iConference.

[26]  Peter A. Gloor,et al.  Social capital increases efficiency of collaboration among Wikipedia editors , 2011, HT '11.

[27]  R. Stuart Geiger,et al.  Participation in Wikipedia's article deletion processes , 2011, Int. Sym. Wikis.

[28]  Robert M. Mason,et al.  Lifting the veil: the expression of values in online communities , 2011, iConference.

[29]  Aniket Kittur,et al.  Coordination and beyond: social functions of groups in open content production , 2012, CSCW.

[30]  Robert E. Kraut,et al.  Socializing volunteers in an online community: a field experiment , 2012, CSCW.

[31]  Aaron Halfaker,et al.  Defense Mechanism or Socialization Tactic? Improving Wikipedia's Notifications to Rejected Contributors , 2012, ICWSM.

[32]  Stefan Decker,et al.  Deletion discussions in Wikipedia: decision factors and outcomes , 2012, WikiSym '12.

[33]  Jonathan T. Morgan,et al.  The Rise and Decline of an Open Collaboration System , 2013 .