Designing Effective Performance Feedback Notification Systems to Stimulate Content Contribution: Evidence from a Crowdsourcing Recipe Platform

This study investigates whether and how a platform’s provision of performance feedback to users about their prior content contributions can help to stimulate users’ subsequent contributions. We draw on social value orientation theory to hypothesize how different framings may impact users’ likelihood of producing additional content. We partnered with a major mobile crowdsourcing recipe platform based in China to conduct a randomized field experiment involving the delivery of feedback messages with randomly determined framings, via mobile push notifications. We find that feedback framed either prosocially or pro-self has a positive effect on content contributions, whereas feedback framed competitively has no such effect. Additionally, we observe differences across genders, such that the positive effects of prosocially framed feedback are significantly stronger for female users. In contrast, competitively framed feedback is only effective for male users. Our findings provide implications for the design of platform-provided performance feedback to stimulate users' content contribution.

[1]  Xiaohua Zeng,et al.  Social Ties and User Content Generation: Evidence from Flickr , 2013, Inf. Syst. Res..

[2]  Yili Hong,et al.  What Are Social Incentives Worth? A Randomized Field Experiment in User Content Generation , 2015, ICIS.

[3]  Olivier Toubia,et al.  Intrinsic vs. Image-Related Utility in Social Media: Why Do People Contribute Content to Twitter? , 2013, Mark. Sci..

[4]  J. F. Veiga,et al.  Explaining sex differences in managerial career satisfier preferences: the role of gender self-schema. , 2006, The Journal of applied psychology.

[5]  X. Zhang,et al.  Group Size and Incentives to Contribute: A Natural Experiment at Chinese Wikipedia , 2010 .

[6]  Ritu Agarwal,et al.  Through a Glass Darkly: Information Technology Design, Identity Verification, and Knowledge Contribution in Online Communities , 2007, Inf. Syst. Res..

[7]  N. Eisenberg,et al.  The relation of empathy to prosocial and related behaviors. , 1987, Psychological bulletin.

[8]  F. Maxwell Harper,et al.  Social Comparisons and Contributions to Online Communities: A Field Experiment on MovieLens , 2010, Computational Social Systems and the Internet.

[9]  Barton A. Weitz,et al.  Learning Orientation, Working Smart, and Effective Selling , 1994 .

[10]  David Wozniak,et al.  Gender differences in a market with relative performance feedback: Professional tennis players , 2012 .

[11]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[12]  Wim B. G. Liebrand,et al.  The ring measure of social values: A computerized procedure for assessing individual differences in information processing and social value orientation , 1988 .

[13]  Eric Gilbert,et al.  Widespread underprovision on Reddit , 2013, CSCW.

[14]  Muriel Niederle,et al.  Do Women shy away from Competition , 2004 .

[15]  Louis Leung,et al.  User-generated content on the internet: an examination of gratifications, civic engagement and psychological empowerment , 2009, New Media Soc..

[16]  Jing Wang,et al.  Bonus, Disclosure, and Choice: What Motivates the Creation of High-Quality Paid Reviews? , 2012, ICIS.

[17]  A. Rustichini,et al.  Performance in Competitive Environments: Gender Differences , 2003 .

[18]  Kaifu Zhang,et al.  Differentiation with User-Generated Content , 2015, Manag. Sci..

[19]  Andreas Glöckner,et al.  Social Value Orientation and information search in social dilemmas: An eye-tracking analysis , 2013 .

[20]  Rachel T. A. Croson,et al.  Gender Differences in Preferences , 2009 .

[21]  David A. Lishner,et al.  Altruism or psychological escape: Why does empathy promote prosocial behavior? , 2009 .

[22]  Swann.  Self-Verification Theory , 2012 .

[23]  Ann Majchrzak.  Results of a Field Experiment , 1986 .

[24]  Bin Gu,et al.  An investigation of information sharing and seeking behaviors in online investment communities , 2014, Comput. Hum. Behav..

[25]  Olga Shurchkov,et al.  UNDER PRESSURE: GENDER DIFFERENCES IN OUTPUT QUALITY AND QUANTITY UNDER COMPETITION AND TIME CONSTRAINTS , 2012 .

[26]  Sylvia Beyer,et al.  Gender differences in the accuracy of self-evaluations of performance , 1990 .

[27]  Yong Tan,et al.  Social Networks and the Diffusion of User-Generated Content: Evidence from YouTube , 2012, Inf. Syst. Res..

[28]  Chunqin Deng,et al.  Paper 267-27 Generating Randomization Schedules Using SAS Programming , 2002 .

[29]  Robert Dur,et al.  Tournament Incentives in the Field: Gender Differences in the Workplace , 2009, Journal of Labor Economics.

[30]  Francesca Gioia,et al.  Overconfidence, omens and gender heterogeneity: Results from a field experiment , 2014 .

[31]  Anders U. Poulsen,et al.  Gender Matching and Competitiveness: Experimental Evidence , 2013 .

[32]  Paulo B. Góes,et al.  Do Incentive Hierarchies Induce User Effort? Evidence from an Online Knowledge Exchange , 2016, Inf. Syst. Res..

[33]  Sang Pil Han,et al.  An Empirical Analysis of User Content Generation and Usage Behavior on the Mobile Internet , 2011, Manag. Sci..

[34]  Richard J. Zeckhauser,et al.  Rank as an inherent incentive: Evidence from a field experiment ☆ , 2012 .

[35]  Yong Tan,et al.  Leveraging Philanthropic Behavior for Customer Support: The Case of User Support Forums , 2014, MIS Q..

[36]  P. V. Lange,et al.  The pursuit of joint outcomes and equality in outcomes: An integrative model of social value orientation. , 1999 .

[37]  Eric T. Bradlow,et al.  Automated Marketing Research Using Online Customer Reviews , 2011 .

[38]  J. Piliavin,et al.  Altruism: A Review of Recent Theory and Research , 1990 .

[39]  Michael Trusov,et al.  Determining Influential Users in Internet Social Networks , 2010 .

[40]  Lee Sproull,et al.  The Role of Feedback in Managing the Internet-Based Volunteer Work Force , 2008, Inf. Syst. Res..

[41]  Ryan O. Murphy,et al.  Measuring Social Value Orientation , 2011, SSRN Electronic Journal.

[42]  David Godes,et al.  Introduction to the Special Issue - Social Media and Business Transformation: A Framework for Research , 2013, Inf. Syst. Res..

[43]  Jinhong Xie,et al.  Online Social Interactions: A Natural Experiment on Word of Mouth versus Observational Learning , 2010 .

[44]  Samer Faraj,et al.  Why Should I Share? Examining Social Capital and Knowledge Contribution in Electronic Networks of Practice , 2005, MIS Q..

[45]  C. Rusbult,et al.  Development of prosocial, individualistic, and competitive orientations: theory and preliminary evidence. , 1997, Journal of personality and social psychology.

[46]  Carl F. Mela,et al.  Managing User-Generated Content: A Dynamic Rational Expectations Equilibrium Approach , 2016, Mark. Sci..

[47]  Bernard J. Jaworski,et al.  Supervisory Feedback: Alternative Types and Their Impact on Salespeople's Performance and Satisfaction , 1991 .

[48]  Louis-Philippe Morin,et al.  Do Men and Women Respond Differently to Competition? Evidence from a Major Education Reform , 2015, Journal of Labor Economics.

[49]  S. Read,et al.  Self-verification processes: How we sustain our self-conceptions , 1981 .

[50]  Imran Rasul,et al.  ignorance ? : a natural experiment on the effect of feedback on students ' performance , 2015 .

[51]  R. Rengasamy,et al.  Gender in Development , 2012 .

[52]  Deva Rangarajan,et al.  Understanding the salespeople's “feedback‐satisfaction” linkage: what role does job perceptions play? , 2008 .

[53]  J. Stockard,et al.  Gender Roles and Behavior in Social Dilemmas: Are There Sex Differences in Cooperation and in Its Justification? , 1988 .

[54]  Ganesh Iyer,et al.  Competing for Attention in Social Communication Markets , 2015, Manag. Sci..

[55]  R. Dawes,et al.  A Conceptual Review of Decision Making in Social Dilemmas: Applying a Logic of Appropriateness , 2004, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[56]  Iwan Barankay,et al.  Gender differences in productivity responses to performance rankings: Evidence from a randomized workplace experiment , 2011 .

[57]  Frederick M. Gordon,et al.  The Complexity of Social Outcomes from Cooperative, Competitive, and Individualistic Reward Systems , 2000 .

[58]  Linley Hartmann,et al.  Gender Differences in Attitudes Toward Affirmative Action Programs in Australia: Effects of Beliefs, Interests, and Attitudes Toward Women , 2001 .