Active Community Participation and Crowdworking Turnover: A Longitudinal Model and Empirical Test of Three Mechanisms

Abstract Crowdworkers, such as Mturk workers, face challenging work conditions, including low pay and unfair treatment. To overcome a lack of means to share information with other workers, they often self-organize in independent online communities, for example, TurkerNation. Although prior research has explored both the crowdwork and online community contexts, it has largely ignored crowdworkers’ dual-context roles. This research provides evidence for the dual-context phenomenon. We propose three theory-driven mechanisms―embeddedness, cross-influence, and moderated heuristics―that, together with the conventional model and the sequential-update mechanism, explained up to 72% of key behavioral outcomes in both contexts. Moreover, crowdworkers’ active participation in online communities had a persistent mitigating effect on their desires to quit working in the crowdworking environment. These findings add to a richer understanding of crowdworkers’ integrated and evolving psychology within the dual-context environment. From a managerial perspective, our findings suggest that crowdwork platforms can better retain their workers by facilitating―and actively engaging with―their discussions in an embedded online community.

[1]  John P. Meyer,et al.  A three-component conceptualization of organizational commitment , 1991 .

[2]  Adam M. Grant Relational Job Design and the Motivation to Make a Prosocial Difference , 2007 .

[3]  Sung S. Kim,et al.  Out of Dedication or Constraint? A Dual Model of Post-Adoption Phenomena and its Empirical Test in the Context of Online Services , 2009, MIS Q..

[4]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[5]  Soumya Ray,et al.  What Leads to Prosocial Behaviors on Social Networking Services: A Tripartite Model , 2017, J. Manag. Inf. Syst..

[6]  Siddharth Suri,et al.  Conducting behavioral research on Amazon’s Mechanical Turk , 2010, Behavior research methods.

[7]  Rajiv Sabherwal,et al.  Usability and Sociability in Online Communities: A Comparative Study of Knowledge Seeking and Contribution , 2009, J. Assoc. Inf. Syst..

[8]  Babak Naderi,et al.  Who are the Crowdworkers , 2018 .

[9]  Bill C. Hardgrave,et al.  Emotional Dissonance and the Information Technology Professional , 2008, MIS Q..

[10]  B. Pan,et al.  A retrospective view of electronic word-of-mouth in hospitality and tourism management , 2017 .

[11]  Jacki O'Neill,et al.  Being a turker , 2014, CSCW.

[12]  Ian R. Gellatly,et al.  Affective and continuance commitment to the organization: Evaluation of measures and analysis of concurrent and time-lagged relations. , 1990 .

[13]  Namjoo Choi,et al.  Information systems attachment: An empirical exploration of its antecedents and its impact on community participation intention , 2013, J. Assoc. Inf. Sci. Technol..

[14]  Naresh K. Malhotra,et al.  A Longitudinal Model of Continued IS Use: An Integrative View of Four Mechanisms Underlying Postadoption Phenomena , 2005, Manag. Sci..

[15]  Traci Hong,et al.  The influence of structural and message features on Web site credibility , 2006, J. Assoc. Inf. Sci. Technol..

[16]  Michael J. Ryan Behavioral intention formation : the interdependency of attitudinal and social influence variables , 1982 .

[17]  Gary L. Lilien,et al.  Location, Location, Location: How Network Embeddedness Affects Project Success in Open Source Systems , 2006, Manag. Sci..

[18]  K. D. Joshi,et al.  The Duality of Empowerment and Marginalization in Microtask Crowdsourcing: Giving Voice to the Less Powerful Through Value Sensitive Design , 2016, MIS Q..

[19]  Magid Igbaria,et al.  Determinants of MIS employees' turnover intentions: a structural equation model , 1992, CACM.

[20]  Sandra Slaughter,et al.  Understanding the Motivations, Participation, and Performance of Open Source Software Developers: A Longitudinal Study of the Apache Projects , 2006, Manag. Sci..

[21]  Bill Tomlinson,et al.  Who are the crowdworkers?: shifting demographics in mechanical turk , 2010, CHI Extended Abstracts.

[22]  Alice M. Brawley,et al.  Work experiences on MTurk: Job satisfaction, turnover, and information sharing , 2016, Comput. Hum. Behav..

[23]  V. Mittal,et al.  Attribute-Level Performance, Satisfaction, and Behavioral Intentions over Time: A Consumption-System Approach , 1999 .

[24]  Robert W. Zmud,et al.  A Comprehensive Conceptualization of Post-Adoptive Behaviors Associated with Information Technology Enabled Work Systems , 2005, MIS Q..

[25]  Terence R. Mitchell,et al.  The Effects of Job Embeddedness on Organizational Citizenship, Job Performance, Volitional Absences, and Voluntary Turnover , 2004 .

[26]  R. Bagozzi,et al.  On the evaluation of structural equation models , 1988 .

[27]  Naresh K. Malhotra,et al.  Common Method Variance in IS Research: A Comparison of Alternative Approaches and a Reanalysis of Past Research , 2006, Manag. Sci..

[28]  Robert C. Ford,et al.  Two (or more?) dimensions of organizational commitment: Reexamination of the affective and continuance commitment scales. , 1987 .

[29]  H. Weiss,et al.  Affective Events Theory: A theoretical discussion of the structure, causes and consequences of affective experiences at work. , 1996 .

[30]  M. Six Silberman,et al.  Operating an Employer Reputation System: Lessons from Turkopticon, 2008-2015 , 2016 .

[31]  Moez Limayem,et al.  Data Collection in the Digital Age: Innovative Alterantives to Student Samples , 2014, MIS Q..

[32]  A. Herrmann,et al.  The Social Influence of Brand Community: Evidence from European Car Clubs , 2005 .

[33]  Ruth N. Bolton,et al.  A Longitudinal Analysis of the Impact of Service Changes on Customer Attitudes , 1991 .

[34]  Sung S. Kim The integrative framework of technology use: an extension and test , 2009 .

[35]  Wynne W. Chin,et al.  Advancing the Theory of Adaptive Structuration: The Development of a Scale to Measure Faithfulness of Appropriation , 1997, Inf. Syst. Res..

[36]  B. Bergvall-Kåreborn,et al.  Amazon Mechanical Turk and the Commodification of Labour , 2014 .

[37]  David G. Rand,et al.  The online laboratory: conducting experiments in a real labor market , 2010, ArXiv.

[38]  Chris J. Sablynski,et al.  WHY PEOPLE STAY: USING JOB EMBEDDEDNESS TO PREDICT VOLUNTARY TURNOVER , 2001 .

[39]  J. L. Price Handbook of Organizational Measurement , 1975 .

[40]  David Mazursky,et al.  A Longitudinal Assessment of Consumer Satisfaction/Dissatisfaction: The Dynamic Aspect of the Cognitive Process , 1983 .

[41]  Ayoung Suh,et al.  Gamification in the Workplace: The Central Role of the Aesthetic Experience , 2017, J. Manag. Inf. Syst..

[42]  Jacki O'Neill,et al.  Turking in a Global Labour Market , 2016, Computer Supported Cooperative Work (CSCW).

[43]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[44]  Atreyi Kankanhalli,et al.  Contributing Knowledge to Electronic Knowledge Repositories: An Empirical Investigation , 2005, MIS Q..

[45]  M. Six Silberman,et al.  Turkopticon: interrupting worker invisibility in amazon mechanical turk , 2013, CHI.

[46]  Lara Khansa,et al.  To Cyberloaf or Not to Cyberloaf: The Impact of the Announcement of Formal Organizational Controls , 2017, J. Manag. Inf. Syst..

[47]  Richard G. Netemeyer,et al.  Handbook of Marketing Scales: Multi-Item Measures for Marketing and Consumer Behavior Research , 1993 .

[48]  Atreyi Kankanhalli,et al.  Special Issue on: Knowledge Management in Asia Understanding Seeking from Electronic Knowledge Repositories: , 2022 .

[49]  R. Oliver,et al.  Crossover effects in the theory of reasoned action: A moderating influence attempt. , 1985 .

[50]  Hani Safadi,et al.  The Emergence of Online Community Leadership , 2015, Inf. Syst. Res..

[51]  Detmar W. Straub,et al.  Structural Equation Modeling and Regression: Guidelines for Research Practice , 2000, Commun. Assoc. Inf. Syst..

[52]  Panagiotis G. Ipeirotis,et al.  The Dynamics of Micro-Task Crowdsourcing: The Case of Amazon MTurk , 2015, WWW.

[53]  S. Venkataraman,et al.  The distinctive domain of entrepreneurship research: An editor''s perspective , 1997 .

[54]  Dorothy E. Leidner,et al.  Digitally enabling social networks: resolving IT–culture conflict , 2013, Inf. Syst. J..

[55]  Samer Faraj,et al.  Why Should I Share? Examining Social Capital and Knowledge Contribution in Electronic Networks of Practice , 2005, MIS Q..

[56]  Alexander Hars,et al.  Web Based Knowledge Infrastructures for the Sciences: An Adaptive Document , 2000, Commun. Assoc. Inf. Syst..

[57]  Izak Benbasat,et al.  Do I Trust You Online, and If So, Will I Buy? An Empirical Study of Two Trust-Building Strategies , 2006, J. Manag. Inf. Syst..

[58]  M. Lindell,et al.  Accounting for common method variance in cross-sectional research designs. , 2001, The Journal of applied psychology.

[59]  Robert H. Moorman,et al.  Relationship between organizational justice and organizational citizenship behaviors : do fairness perceptions influence employee citizenship ? , 1991 .

[60]  Richard M. Steers,et al.  Organizational commitment, job satisfaction, and turnover among psychiatric technicians. , 1974 .

[61]  Brian S. Butler,et al.  Research Note - The Impact of Community Commitment on Participation in Online Communities , 2011, Inf. Syst. Res..

[62]  John J. Horton,et al.  Research Note - Are Online Labor Markets Spot Markets for Tasks? A Field Experiment on the Behavioral Response to Wage Cuts , 2016, Inf. Syst. Res..

[63]  J. Tirole,et al.  Some Simple Economics of Open Source , 2002 .

[64]  R. Hogarth,et al.  Order effects in belief updating: The belief-adjustment model , 1992, Cognitive Psychology.

[65]  Ronald J. Faber,et al.  Compulsive Buying: A Phenomenological Exploration , 1989 .

[66]  Ritu Agarwal,et al.  Through a Glass Darkly: Information Technology Design, Identity Verification, and Knowledge Contribution in Online Communities , 2007, Inf. Syst. Res..

[67]  J. Dittrich,et al.  Organizational equity perceptions, employee job satisfaction, and departmental absence and turnover rates. , 1979, Organizational behavior and human performance.

[68]  Kai H. Lim,et al.  Understanding sustained participation in transactional virtual communities , 2012, Decis. Support Syst..

[69]  Jason A. Colquitt,et al.  Justice, Trust, and Trustworthiness: A Longitudinal Analysis Integrating Three Theoretical Perspectives , 2011 .

[70]  Ruth N. Bolton,et al.  A Dynamic Model of the Duration of the Customer's Relationship with a Continuous Service Provider: The Role of Satisfaction , 1994 .

[71]  Soumya Ray,et al.  The Central Role of Engagement in Online Communities , 2014, Inf. Syst. Res..

[72]  John P. Hausknecht,et al.  One Hundred Years of Employee Turnover Theory and Research , 2017, The Journal of applied psychology.

[73]  Patrick Y. K. Chau,et al.  Who Do You Think You Are? Common and Differential Effects of Social Self-Identity on Social Media Usage , 2017, J. Manag. Inf. Syst..

[74]  P. Blau Exchange and Power in Social Life , 1964 .

[75]  Jacki O'Neill,et al.  Turk-Life in India , 2014, GROUP.

[76]  Franziska Marquart,et al.  Communication and persuasion : central and peripheral routes to attitude change , 1988 .

[77]  Xiao Ma,et al.  Understanding Members’ Active Participation in Online Question-and-Answer Communities: A Theory and Empirical Analysis , 2015, J. Manag. Inf. Syst..

[78]  Xiao Ma,et al.  Toward a Contextual Theory of Turnover Intention in Online Crowdworking , 2016, ICIS.

[79]  Anol Bhattacherjee,et al.  Influence Processes for Information Technology Acceptance: An Elaboration Likelihood Model , 2006, MIS Q..

[80]  Anol Bhattacherjee,et al.  Understanding Information Systems Continuance: An Expectation-Confirmation Model , 2001, MIS Q..

[81]  Robert M. Davison,et al.  Research in Information Systems: Intra-Disciplinary and Inter-Disciplinary Approaches , 2018, J. Assoc. Inf. Syst..

[82]  Yan Li,et al.  Leadership characteristics and developers' motivation in open source software development , 2012, Inf. Manag..

[83]  Albert H. Segars,et al.  Assessing the unidimensionality of measurement : a paradigm and illustration within the context of information systems research , 1997 .

[84]  M. Six Silberman,et al.  Human-centered computing and the future of work: lessons from Mechanical Turk and Turkopticon, 2008-2015 , 2015 .