Stimulating Online Reviews by Combining Financial Incentives and Social Norms

In hopes of motivating consumers to provide larger volumes of useful reviews, many retailers offer financial incentives. Here, we explore an alternative approach, social norms. We inform individuals about the volume of reviews authored by peers. We test the effectiveness of using financial incentives, social norms, and a combination of both strategies in motivating consumers. In two randomized experiments, one in the field conducted in partnership with a large online clothing retailer based in China and a second on Amazon Mechanical Turk, we compare the effectiveness of each strategy in stimulating online reviews in larger numbers and of greater length. We find that financial incentives are more effective at inducing larger volumes of reviews, but the reviews that result are not particularly lengthy, whereas social norms have a greater effect on the length of reviews. Importantly, we show that the combination of financial incentives and social norms yields the greatest overall benefit by motivating review...

[1]  Bruno S. Frey,et al.  How Intrinsic Motivation is Crowded out and in , 1994 .

[2]  Noah J. Goldstein,et al.  A Room with a Viewpoint: Using Social Norms to Motivate Environmental Conservation in Hotels , 2008 .

[3]  David Schuff,et al.  What Makes a Helpful Review? A Study of Customer Reviews on Amazon.com , 2010 .

[4]  Elliott Jaques,et al.  The Social and Psychological Impact of a Change in Method of Wage Payment , 1951 .

[5]  H. Allcott,et al.  Social Norms and Energy Conservation , 2011 .

[6]  George Loewenstein,et al.  Tightwads and Spendthrifts , 2007 .

[7]  E. Deci,et al.  A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. , 1999, Psychological bulletin.

[8]  Christophe Diot,et al.  Finding a needle in a haystack of reviews: cold start context-based hotel recommender system , 2012, RecSys.

[9]  J. Shaw,et al.  Are financial incentives related to performance? A meta-analytic review of empirical research. , 1998 .

[10]  Noah J. Goldstein,et al.  Normative Social Influence is Underdetected , 2008, Personality & social psychology bulletin.

[11]  Eric Robinson,et al.  Prompting healthier eating: testing the use of health and social norm based messages. , 2014, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[12]  Mehnaz Turner,et al.  A Room , 2010 .

[13]  D. Ariely,et al.  Effort for Payment , 2004, Psychological science.

[14]  Marcel Zeelenberg,et al.  Dispositional greed. , 2015, Journal of personality and social psychology.

[15]  L. Doob.  The psychology of social norms. , 1937 .

[16]  H. Kelley,et al.  The social psychology of groups , 1960 .

[17]  F. Maxwell Harper,et al.  Social Comparisons and Contributions to Online Communities: A Field Experiment on MovieLens , 2010, Computational Social Systems and the Internet.

[18]  Qing Cao,et al.  Exploring determinants of voting for the "helpfulness" of online user reviews: A text mining approach , 2011, Decis. Support Syst..

[19]  Jana Gallus,et al.  Fostering Public Good Contributions with Symbolic Awards: A Large-Scale Natural Field Experiment at Wikipedia , 2017, Manag. Sci..

[20]  Noah J. Goldstein,et al.  Social influence: compliance and conformity. , 2004, Annual review of psychology.

[21]  Izak Benbasat,et al.  The Effects of Presentation Formats and Task Complexity on Online Consumers' Product Understanding , 2007, MIS Q..

[22]  Angelika Dimoka,et al.  ON PRODUCT UNCERTAINTY IN ONLINE MARKETS , 2012 .

[23]  Kevin G. Volpp,et al.  A Randomized Controlled Trial of Financial Incentives for Smoking Cessation , 2009 .

[24]  Chrysanthos Dellarocas,et al.  The Digitization of Word-of-Mouth: Promise and Challenges of Online Feedback Mechanisms , 2003, Manag. Sci..

[25]  Roberta Minazzi,et al.  The Digitization of Word-of-Mouth , 2015 .

[26]  Paulo B. Góes,et al.  Do Incentive Hierarchies Induce User Effort? Evidence from an Online Knowledge Exchange , 2016, Inf. Syst. Res..

[27]  E. Anderson.  Customer Satisfaction and Word of Mouth , 1998 .

[28]  Matthew Pearson,et al.  Bias and Reciprocity in Online Reviews: Evidence From Field Experiments on Airbnb , 2015, EC.

[29]  Yong Tan,et al.  Leveraging Philanthropic Behavior for Customer Support: The Case of User Support Forums , 2014, MIS Q..

[30]  S. Asch.  Effects of Group Pressure Upon the Modification and Distortion of Judgments , 1951 .

[31]  R. Cialdini,et al.  Social influence: Social norms, conformity and compliance. , 1998 .

[32]  Warut Khern-am-nuai,et al.  Extrinsic versus Intrinsic Rewards to Participate in a Crowd Context: An Analysis of a Review Platform , 2016 .

[33]  M. Hoffman.  Is altruism part of human nature , 1981 .

[34]  Michael Luca,et al.  User-Generated Content and Social Media , 2021, E-Commerce and Convergence: A Guide to the Law of Digital Media.

[35]  Jing Wang,et al.  Bonus, Disclosure, and Choice: What Motivates the Creation of High-Quality Paid Reviews? , 2012, ICIS.

[36]  Ming Zhou,et al.  Low-Quality Product Review Detection in Opinion Summarization , 2007, EMNLP.

[37]  R. Barnes.  Motion and time study , 1950 .

[38]  J. Henrich,et al.  Costly Punishment Across Human Societies , 2006, Science.

[39]  Michael K. Price,et al.  Using Nonpecuniary Strategies to Influence Behavior: Evidence from a Large-Scale Field Experiment , 2011, Review of Economics and Statistics.

[40]  Anindya Ghose,et al.  The Hidden Cost of Accommodating Crowdfunder Privacy Preferences: A Randomized Field Experiment , 2014, Manag. Sci..

[41]  David Eichelberger,et al.  Handbook Of Psychological Testing , 2016 .

[42]  Todd Rogers,et al.  Descriptive Social Norms and Motivation to Vote: Everybody's Voting and so Should You , 2009, The Journal of Politics.

[43]  F. H. Hankins,et al.  The Psychology of Social Norms , 1937 .

[44]  P. Kline.  The handbook of psychological testing, 2nd ed. , 1993 .

[45]  Kuang-Hwei Lee–Smeltzer,et al.  Finding the needle , 2000 .

[46]  Ronald Lippitt,et al.  A Laboratory Study of Behavioral Contagion , 1951 .

[47]  Jun Wang,et al.  What makes a helpful online review? A meta-analysis of review characteristics , 2018, Electronic Commerce Research.

[48]  Lydia B. Chilton,et al.  The labor economics of paid crowdsourcing , 2010, EC '10.

[49]  Duncan J. Watts,et al.  Financial incentives and the "performance of crowds" , 2009, HCOMP '09.

[50]  Lingfang Li,et al.  A Dollar for Your Thoughts: Feedback-Conditional Rebates on Ebay , 2014, Manag. Sci..

[51]  A. Stephen,et al.  Does Paying for Online Product Reviews Pay Off? The Effects of Monetary Incentives on Consumers’ Product Evaluations , 2012 .

[52]  Annamaria Di Fabio,et al.  Prosocial Organizational Behaviors Scale: primo contributo alla validazione della versione italiana , 2016 .

[53]  Dylan Walker,et al.  Creating Social Contagion Through Viral Product Design: A Randomized Trial of Peer Influence in Networks , 2010, ICIS.

[54]  Robert B. Cialdini,et al.  A focus theory of normative conduct , 1990 .

[55]  Angelika Dimoka,et al.  On Product Uncertainty in Online Markets: Theory and Evidence , 2011, MIS Q..

[56]  Judith A. McLaughlin.  Understanding Statistics in the Behavioral Sciences , 2002 .

[57]  Yakov Bart,et al.  Does paying for online product reviews pay off? The effects of monetary incentives on content creators and consumers , 2012 .

[58]  Carl A. Kallgren,et al.  A Focus Theory of Normative Conduct: A Theoretical Refinement and Reevaluation of the Role of Norms in Human Behavior , 1991 .

[59]  Beth A. Hennessey,et al.  Immunizing children against the negative effects of reward: A further examination of intrinsic motivation training techniques , 1993 .

[60]  Noah J. Goldstein,et al.  The Constructive, Destructive, and Reconstructive Power of Social Norms , 2007, Psychological science.

[61]  Panagiotis G. Ipeirotis.  Demographics of Mechanical Turk , 2010 .

[62]  P. Resnick,et al.  The Market for Evaluations , 1999 .

[63]  Beth L. Green,et al.  Undermining the Undermining Effect of Reward on Sustained Interest1 , 1998 .

[64]  David A. Lishner,et al.  Altruism or psychological escape: Why does empathy promote prosocial behavior? , 2009 .