Quality Hackathon: Evaluating the Products of Online Co-Production Systems

This full-day workshop focuses on building Big Social Data research competencies for scholars interested in issues of contribution quality and contributor performance in online co-production systems that generate value through contributions by volunteers. The workshop is designed to engage discussion and promote co-working through a hackathon format to stimulate productive conversation and learning, using shared data sets to provide a common focus for participants to engage questions of contribution quality and contributor performance with multiple disciplinary, theoretical, and analytical backgrounds.

[1]  Loren G. Terveen,et al.  Quality is a verb: the operationalization of data quality in a citizen science community , 2011, Int. Sym. Wikis.

[2]  Joshua Evan Blumenstock,et al.  Size matters: word count as a measure of quality on wikipedia , 2008, WWW.

[3]  Paul Duguid,et al.  Limits of self-organization: Peer production and "laws of quality" , 2006, First Monday.

[4]  Jan Marco Leimeister,et al.  Rating Scales for Collective Intelligence in Innovation Communities: Why Quick and Easy Decision Making Does Not Get it Right , 2010, ICIS.

[5]  Jeffrey Pomerantz,et al.  Evaluating and predicting answer quality in community QA , 2010, SIGIR.

[6]  Ioannis Stamelos,et al.  Evaluating the Quality of Open Source Software , 2009, SQM@CSMR.

[7]  Eugene Agichtein,et al.  Discovering authorities in question answer communities by using link analysis , 2007, CIKM '07.

[8]  Sandro Morasca,et al.  OpenBQR: a framework for the assessment of OSS , 2007, OSS.

[9]  Masatoshi Yoshikawa,et al.  QualityRank: assessing quality of wikipedia articles by mutually evaluating editors and texts , 2012, HT '12.

[10]  Jennifer Preece,et al.  Sociability and usability in online communities: Determining and measuring success , 2001, Behav. Inf. Technol..

[11]  Aniket Kittur,et al.  Harnessing the wisdom of crowds in wikipedia: quality through coordination , 2008, CSCW.

[12]  Steve Kelling,et al.  Data-intensive science applied to broad-scale citizen science. , 2012, Trends in ecology & evolution.

[13]  Sheizaf Rafaeli,et al.  Predictors of answer quality in online Q&A sites , 2008, CHI.

[14]  Kevin Crowston,et al.  Exploring Data Quality in Games With a Purpose , 2014 .

[15]  Ioannis Stamelos,et al.  The SQO-OSS Quality Model: Measurement Based Open Source Software Evaluation , 2008, OSS.