Turkopticon: interrupting worker invisibility in amazon mechanical turk

As HCI researchers have explored the possibilities of human computation, they have paid less attention to ethics and values of crowdwork. This paper offers an analysis of Amazon Mechanical Turk, a popular human computation system, as a site of technically mediated worker-employer relations. We argue that human computation currently relies on worker invisibility. We then present Turkopticon, an activist system that allows workers to publicize and evaluate their relationships with employers. As a common infrastructure, Turkopticon also enables workers to engage one another in mutual aid. We conclude by discussing the potentials and challenges of sustaining activist technologies that intervene in large, existing socio-technical systems.

[1]  Ann Light,et al.  Digital interdependence and how to design for it , 2011, INTR.

[2]  Tad Hirsch,et al.  FEATURELearning from activists: lessons for designers , 2009, INTR.

[3]  Carl DiSalvo,et al.  Adversarial Design , 2012 .

[4]  M. Berg.  The Politics of Technology: On Bringing Social Theory into Technological Design , 1998 .

[5]  D. Gunzburg.  New forms of work organization , 1985 .

[6]  Paul Dourish,et al.  Ubicomp's colonial impulse , 2012, UbiComp.

[7]  Karen Ruhleder,et al.  Steps Toward an Ecology of Infrastructure: Design and Access for Large Information Spaces , 1996, Inf. Syst. Res..

[8]  Lucy A. Suchman,et al.  Making work visible , 1995, CACM.

[9]  Paul Dourish,et al.  HCI and environmental sustainability: the politics of design and the design of politics , 2010, Conference on Designing Interactive Systems.

[10]  Alex S. Taylor,et al.  Out there , 2011, CHI.

[11]  Kavita Philip,et al.  Tactical Biopolitics : Art, Activism, and Technoscience , 2008 .

[12]  W. Orlikowski.  The Duality of Technology: Rethinking the Concept of Technology in Organizations , 2014 .

[13]  C. DiSalvo,et al.  Design and the Construction of Publics , 2009, Design Issues.

[14]  Genevieve Bell,et al.  Opening keynote , 2006, Australasian Computer-Human Interaction Conference.

[15]  Brendan T. O'Connor,et al.  Cheap and Fast – But is it Good? Evaluating Non-Expert Annotations for Natural Language Tasks , 2008, EMNLP.

[16]  Bill Tomlinson,et al.  Who are the crowdworkers?: shifting demographics in mechanical turk , 2010, CHI Extended Abstracts.

[17]  Phoebe Sengers,et al.  Sustainably unpersuaded: how persuasion narrows our vision of sustainability , 2012, CHI.

[18]  Christopher A. Le Dantec,et al.  Participation and publics: supporting community engagement , 2012, CHI.

[19]  Shaowen Bardzell,et al.  Feminist HCI: taking stock and outlining an agenda for design , 2010, CHI.

[20]  JoAnne Yates,et al.  Information technology and organizational transformation : history, rhetoric, and practice , 2001 .

[21]  Susan Leigh Star,et al.  Layers of Silence, Arenas of Voice: The Ecology of Visible and Invisible Work , 1999, Computer Supported Cooperative Work (CSCW).

[22]  K. Crenshaw.  Mapping the margins: intersectionality, identity politics, and violence against women of color , 1991 .

[23]  Alan Borning,et al.  Next steps for value sensitive design , 2012, CHI.

[24]  Mark S. Ackerman,et al.  The Intellectual Challenge of CSCW: The Gap Between Social Requirements and Technical Feasibility , 2000, Hum. Comput. Interact..

[25]  Paul Resnick,et al.  Slash(dot) and burn: distributed moderation in a large online conversation space , 2004, CHI.

[26]  M. Mcneil.  Simians, Cyborgs and Women: The Reinvention of Nature , 1992 .

[27]  V. Smith.  Gurus, Hired Guns, and Warm Bodies: Itinerant Experts in a Knowledge Economy , 2004 .

[28]  Lucy Suchman,et al.  Human-Machine Reconfigurations: Plans and Situated Actions , 2006 .

[29]  J. Law.  After Method: Mess in Social Science Research , 2004 .

[30]  Christopher Kelty,et al.  Two Bits: The Cultural Significance of Free Software , 2008 .

[31]  Luis von Ahn.  Human Computation , 2008, ICDE.

[32]  Martha Albertson Fineman,et al.  Mapping the Margins: Intersectionality, Identity Politics, and Violence Against Women of Color , 2013 .

[33]  Panagiotis G. Ipeirotis.  Demographics of Mechanical Turk , 2010 .

[34]  Steven J. Jackson,et al.  Things fall apart: maintenance, repair, and technology for education initiatives in rural Namibia , 2011, iConference.

[35]  J. Overhage,et al.  Sorting Things Out: Classification and Its Consequences , 2001, Annals of Internal Medicine.

[36]  Amy Bruckman,et al.  Using Empirical Data to Reason About Internet Research Ethics , 2005, ECSCW.

[37]  Alek Felstiner.  Working the Crowd: Employment and Labor Law in the Crowdsourcing Industry , 2011 .

[38]  Elizabeth F. Churchill,et al.  Profanity use in online communities , 2012, CHI.

[39]  Panagiotis G. Ipeirotis.  Analyzing the Amazon Mechanical Turk marketplace , 2010, XRDS.