Turker Tales: Integrating Tangential Play into Crowd Work

While past work has admirably supported crowd workers in improving their work performance, we argue that there is also value in designing for enjoyment untied from work outcomes--- what we call "tangential play.'' To this end, we present Turker Tales, a Google Chrome extension that uses tangential play to encourage crowd workers to write, share, and view short tales as a side activity to their main job on Amazon Mechanical Turk (MTurk). Turker Tales introduces a layer of playful narrativization atop typical crowd work tasks in order to alter workers' experiences of those tasks without aiming to improve work efficiency or quality. Using speed-dating (N=12) and a pilot test (N=150) to inform our design, we deployed Turker Tales over one week with 171 participants, receiving 1,096 tales and 1,527 ratings of those tales. We found that our system of tangential play brought to light underlying conflicts (such as unfair working conditions), and provided a space for participants to reveal aspects of themselves and their shared experiences. Through Turker Tales, we critically reflect on the roles of researchers, designers, and requesters in crowd work, and the ethics of incorporating play into crowd work, and consider the implications of the paradigm we introduce both as a method of research through design and as a direction for design to support crowd workers.

[1]  Yu Cui,et al.  A Community Rather Than A Union: Understanding Self-Organization Phenomenon on MTurk and How It Impacts Turkers and Requesters , 2017, CHI Extended Abstracts.

[2]  Emanuele Castano,et al.  Reading Literary Fiction Improves Theory of Mind , 2013, Science.

[3]  Carly A. Kocurek,et al.  Taylorism 2.0: Gamification, Scientific Management and the Capitalist Appropriation of Play , 2014 .

[4]  J. Huizinga.  Homo Ludens: A Study of the Play-Element in Culture , 1938 .

[5]  B. Sutton-Smith,et al.  The folkstories of children , 1981 .

[6]  Tetsunori Kobayashi,et al.  TurkScanner: Predicting the Hourly Wage of Microtasks , 2019, WWW.

[7]  J. Pennebaker.  Writing About Emotional Experiences as a Therapeutic Process , 1997 .

[8]  Susan Leigh Star,et al.  Layers of Silence, Arenas of Voice: The Ecology of Visible and Invisible Work , 1999, Computer Supported Cooperative Work (CSCW).

[9]  Elizabeth Gerber,et al.  Combining crowdsourcing and learning to improve engagement and performance , 2014, CHI.

[10]  Erin R. Fluegge-Woolf.  Play hard, work hard: Fun at work and job performance , 2014 .

[11]  Neha Gupta,et al.  Modus Operandi of Crowd Workers , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[12]  Meredith Ringel Morris,et al.  Gauging Receptiveness to Social Microvolunteering , 2015, CHI.

[13]  Scott R. Klemmer,et al.  Shepherding the crowd yields better work , 2012, CSCW.

[14]  Madeleine Bunting.  Willing Slaves: How the Overwork Culture is Ruling Our Lives , 2004 .

[15]  Mary L. Gray,et al.  The Crowd is a Collaborative Network , 2016, CSCW.

[16]  Anna L. Cox,et al.  “I want to be a captain! I want to be a captain!”: gamification in the old weather citizen science project , 2013, Gamification.

[17]  A. Wandersman,et al.  An introduction to citizen participation, voluntary organizations, and community development: Insights for empowerment through research , 1990 .

[18]  M. Sicart.  Play Matters , 2014 .

[19]  Katherine A. Karl,et al.  Is Fun for Everyone? Personality Differences in Healthcare Providers’ Attitudes toward Fun , 2007, Journal of health and human services administration.

[20]  Aida Isabel Tavares,et al.  Telework and health effects review , 2017 .

[21]  Saiph Savage,et al.  Crowd Work on a CV? Understanding How AMT Fits into Turkers' Career Goals and Professional Profiles , 2019, ArXiv.

[22]  Maria Ferris,et al.  Does it matter where you work? A comparison of how three work venues (traditional office, virtual office, and home office) influence aspects of work and personal/family life , 2003 .

[23]  J. Moran-Ellis.  The ambiguity of play , 1998 .

[24]  Arwid Lund,et al.  A Contribution to a Critique of the Concept Playbour , 2015 .

[25]  Aleksejs Busarovs,et al.  Ethical Aspects of Crowdsourcing, or is it a Modern Form of Exploitation , 2013 .

[26]  Mary Flanagan,et al.  How Games Can Help Us Access and Understand Archival Images , 2012 .

[27]  Linda Trenberth,et al.  An exploration of the role of leisure in coping with work related stress using sequential tree analysis , 2005 .

[28]  Benjamin B. Bederson,et al.  Web workers unite! addressing challenges of online laborers , 2011, CHI Extended Abstracts.

[29]  Alvin W. Gouldner.  Alienation from Hegel to Marx , 1980 .

[30]  Laurie Block,et al.  “Listen and I tell you something”: Storytelling and social action in the healing of the oppressed , 2005 .

[31]  Anne-Laure Fayard,et al.  Photocopiers and Water-coolers: The Affordances of Informal Interaction , 2007 .

[32]  C. Jung,et al.  Man and His Symbols , 1964 .

[33]  Kathryn Stafford,et al.  Does Fun Pay? The Impact of Workplace Fun on Employee Turnover and Performance , 2013 .

[34]  Padmini Srinivasan,et al.  Quality through flow and immersion: gamifying crowdsourced relevance assessments , 2012, SIGIR '12.

[35]  Karin Hansson,et al.  From alienation to relation: Examining the modes of production in crowdsourcing , 2017, ECSCW Exploratory Papers.

[36]  Soydan Soylu,et al.  Creating a Family or Loyalty-Based Framework: The Effects of Paternalistic Leadership on Workplace Bullying , 2011 .

[37]  Bill Tomlinson,et al.  Who are the crowdworkers?: shifting demographics in mechanical turk , 2010, CHI Extended Abstracts.

[38]  Krzysztof Z. Gajos,et al.  Curiosity Killed the Cat, but Makes Crowdwork Better , 2016, CHI.

[39]  Rosta Farzan,et al.  Results from deploying a participation incentive mechanism within the enterprise , 2008, CHI.

[40]  Lilly Irani,et al.  The cultural work of microwork , 2015, New Media Soc..

[41]  Ya'akov Gal,et al.  Improving Productivity in Citizen Science through Controlled Intervention , 2015, WWW.

[42]  Lukas Biewald,et al.  Programmatic Gold: Targeted and Scalable Quality Assurance in Crowdsourcing , 2011, Human Computation.

[43]  K. Dautenhahn,et al.  Arti(cid:12)cial Life and Natural Stories , 1998 .

[44]  R. Durazo-Arvizu,et al.  Storytelling. A strategy for living and coping with cancer. , 2000, Cancer nursing.

[45]  Dario Taraborelli,et al.  MoodBar: Increasing New User Retention in Wikipedia through Lightweight Socialization , 2014, CSCW.

[46]  Michael S. Bernstein,et al.  Daemo: A Self-Governed Crowdsourcing Marketplace , 2015, UIST.

[47]  Elena L. Glassman,et al.  Learnersourcing Personalized Hints , 2016, CSCW.

[48]  M. Six Silberman,et al.  Turkopticon: interrupting worker invisibility in amazon mechanical turk , 2013, CHI.

[49]  Barbara Plester,et al.  Crossing the line: boundaries of workplace humour and fun , 2009 .

[50]  Peter Norvig,et al.  Can Distributed Volunteers Accomplish Massive Data Analysis Tasks , 2001 .

[51]  Barbara Plester,et al.  Fun times: the relationship between fun and workplace engagement , 2016 .

[52]  K. D. Joshi,et al.  Is Crowdsourcing a Source of Worker Empowerment or Exploitation? Understanding Crowd Workers' Perceptions of Crowdsourcing Career , 2013, ICIS.

[53]  Peng Dai,et al.  And Now for Something Completely Different: Improving Crowdsourcing Workflows with Micro-Diversions , 2015, CSCW.

[54]  M. Six Silberman,et al.  Stories We Tell About Labor: Turkopticon and the Trouble with "Design" , 2016, CHI.

[55]  F. Biley,et al.  Thoughts on the therapeutic use of narrative in the promotion of coping in cancer care. , 2004, European journal of cancer care.

[56]  Janine Berg,et al.  Income Security in the On-Demand Economy: Findings and Policy Lessons from a Survey of Crowdworkers , 2016 .

[57]  Ethan Mollick,et al.  Mandatory Fun: Consent, Gamification and the Impact of Games at Work , 2014 .

[58]  Vivian Gussin Paley,et al.  A Child's Work: The Importance of Fantasy Play , 2004 .

[59]  Chris Callison-Burch,et al.  Crowd-Workers: Aggregating Information Across Turkers to Help Them Find Higher Paying Work , 2014, HCOMP.

[60]  Jacki O'Neill,et al.  Being a turker , 2014, CSCW.

[61]  Shira Gabriel,et al.  Becoming a Vampire Without Being Bitten , 2011, Psychological science.

[62]  Mihaela van der Schaar,et al.  Reputation-based incentive protocols in crowdsourcing applications , 2011, 2012 Proceedings IEEE INFOCOM.

[63]  John Zimmerman,et al.  Rapidly Exploring Application Design Through Speed Dating , 2007, UbiComp.

[64]  Ke Mao,et al.  Context-Centric Pricing: Early Pricing Models for Software Crowdsourcing Tasks , 2017, PROMISE.

[65]  Ido Guy,et al.  Games for Crowds: A Crowdsourcing Game Platform for the Enterprise , 2015, CSCW.

[66]  Xiaohui Yan,et al.  A biterm topic model for short texts , 2013, WWW.

[67]  Michael S. Bernstein,et al.  The future of crowd work , 2013, CSCW.

[68]  Patsy Cooper.  When Stories Come to School: Telling, Writing, and Performing Stories in the Early Childhood Classroom , 2007 .

[69]  Keith Oatley,et al.  On Being Moved by Art: How Reading Fiction Transforms the Self , 2009 .

[70]  P. Speer,et al.  Community organizing: An ecological route to empowerment and power , 1995, American journal of community psychology.

[71]  P. Fleming.  Workers’ Playtime? , 2005 .

[72]  Chris Callison-Burch,et al.  A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk , 2017, CHI.

[73]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[74]  J. Goggin.  Playbour, farming and leisure. , 2011 .

[75]  Michael S. Bernstein,et al.  We Are Dynamo: Overcoming Stalling and Friction in Collective Action for Crowd Workers , 2015, CHI.

[76]  Leonard Reinecke,et al.  Games at Work: The Recreational Use of Computer Games During Working Hours , 2009, Cyberpsychology Behav. Soc. Netw..

[77]  David Solnet,et al.  The staff break room as an oasis: Emotional labour, restorative environments and employee wellbeing in the hospitality industry , 2015 .

[78]  Saiph Savage,et al.  Crowd Coach , 2018, Proc. ACM Hum. Comput. Interact..

[79]  Raul Ferrer Conill.  Playbour and the gamification of work : Liminal spaces of empowerment and exploitation , 2017 .

[80]  G. Aarons,et al.  Organizational Climate Partially Mediates the Effect of Culture on Work Attitudes and Staff Turnover in Mental Health Services , 2006, Administration and Policy in Mental Health and Mental Health Services Research.

[81]  Daniel Pressnitzer,et al.  Auditory Perception: Laurel and Yanny Together at Last , 2018, Current Biology.

[82]  Peter Fleming,et al.  'Kindergarten Cop': Paternalism and Resistance in a High-Commitment Workplace , 2005 .

[83]  Kristina A. Bourne,et al.  Living in a Culture of Overwork , 2014 .

[84]  John Le,et al.  Ensuring quality in crowdsourced search relevance evaluation: The effects of training question distribution , 2010 .

[85]  Ronald J. Burke,et al.  Workaholism in organizations: the role of organizational values , 2001 .

[86]  N. Wallerstein,et al.  Introduction to Community Empowerment, Participatory Education, and Health , 1994, Health education quarterly.