The Persuasive Power of Algorithmic and Crowdsourced Advice

Abstract Prior research has shown that both advice generated through algorithms and advice resulting from averaging peers’ input can impact users’ decision-making. However, it is not clear which advice type is more closely followed and if changes in decision-making should be attributed to the source or the content of the advice. We examine the effects of algorithmic and social advice on decision-making in the context of an online retirement saving system. By varying both the advice’s message and the attributed messenger, we assess what it is about the advice that people follow. We find that both types of advice have a positive effect on users’ saving performance, and that users follow advice presented as coming from an algorithmic source more closely than advice presented as crowdsourced. Our results shed light on how people view and follow online advice, and on information systems’ persuasive effects under conditions of uncertainty.

[1]  Peter Pirolli,et al.  Do your friends make you smarter?: An analysis of social strategies in online information seeking , 2010, Inf. Process. Manag..

[2]  William Allen,et al.  The influence of source credibility on communication effectiveness , 1953 .

[3]  Chris Edwards,et al.  Using patient data for personalized cancer treatments , 2014, Commun. ACM.

[4]  Gerald Tesauro,et al.  Analysis of Watson's Strategies for Playing Jeopardy! , 2013, J. Artif. Intell. Res..

[5]  R. Kraut,et al.  Varieties of Social Influence: the Role of Utility and Norms in the Success of a New Communication Medium , 1998 .

[6]  A. Dicker,et al.  Patient-oriented cancer information on the internet: a comparison of wikipedia and a professionally maintained database. , 2011, Journal of oncology practice.

[7]  A. Beck,et al.  Cognitive behavior therapy : basics and beyond , 2011 .

[8]  Robert Sugden,et al.  On Nudging: A Review of Nudge: Improving Decisions About Health, Wealth and Happiness by Richard H. Thaler and Cass R. Sunstein , 2009 .

[9]  Adam J. Berinsky,et al.  Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk , 2012, Political Analysis.

[10]  Joseph P. Simmons,et al.  Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them , 2016, Manag. Sci..

[11]  Izak Benbasat,et al.  Recommendation Agents for Electronic Commerce: Effects of Explanation Facilities on Trusting Beliefs , 2007, J. Manag. Inf. Syst..

[12]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[13]  Haiyi Zhu,et al.  To Switch or Not To Switch , 2012, CHI.

[14]  O. Mitchell,et al.  Target-Date Funds in 401(K) Retirement Plans , 2012 .

[15]  G. Hamilton,et al.  The power of obedience. , 1984 .

[16]  Ethan Mollick,et al.  Wisdom or Madness? Comparing Crowds with Expert Evaluation in Funding the Arts , 2015, Manag. Sci..

[17]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[18]  Yaniv,et al.  Advice Taking in Decision Making: Egocentric Discounting and Reputation Formation. , 2000, Organizational behavior and human decision processes.

[19]  R. C. Merton,et al.  Lifetime Portfolio Selection under Uncertainty: The Continuous-Time Case , 1969 .

[20]  Reid Hastie,et al.  Calibration Trumps Confidence as a Basis for Witness Credibility , 2006, Psychological science.

[21]  T. Tyler,et al.  A Relational Model of Authority in Groups , 1992 .

[22]  B. J. Fogg,et al.  Credibility and computing technology , 1999, CACM.

[23]  R. Cialdini Influence: The Psychology of Persuasion , 1993 .

[24]  Mao Ye,et al.  Exploring social influence for recommendation: a generative model approach , 2012, SIGIR '12.

[25]  R. Thaler,et al.  The Behavioral Economics of Retirement Savings Behavior , 2007 .

[26]  L. Festinger A Theory of Social Comparison Processes , 1954 .

[27]  J. Cacioppo,et al.  Issue involvement can increase or decrease persuasion by enhancing message-relevant cognitive responses. , 1979 .

[28]  Christian Posse,et al.  Social referral: leveraging network connections to deliver recommendations , 2012, RecSys '12.

[29]  Wai Fong Boh,et al.  A Temporal Study of the Effects of Online Opinions: Information Sources Matter , 2017, J. Manag. Inf. Syst..

[30]  L Goldman,et al.  Multifactorial index of cardiac risk in noncardiac surgical procedures. , 1977, The New England journal of medicine.

[31]  Daniel J. Brass,et al.  Friendships in Online Peer-to-Peer Lending: Pipes, Prisms, and Relational Herding , 2015 .

[32]  S. Huffmon Expert Political Judgment: How Good Is It? How Can We Know? , 2006 .

[33]  Clifford Nass,et al.  Computers are social actors , 1994, CHI '94.

[34]  Dylan Walker,et al.  Creating Social Contagion Through Viral Product Design: A Randomized Trial of Peer Influence in Networks , 2010, ICIS.

[35]  Izak Benbasat,et al.  Empirical Assessment of Alternative Designs for Enhancing Different Types of Trusting Beliefs in Online Recommendation Agents , 2016, J. Manag. Inf. Syst..

[36]  R. Clark IGNORANCE IS NOT BLISS: THE IMPORTANCE OF FINANCIAL EDUCATION , 2003 .

[37]  David G. Rand,et al.  The online laboratory: conducting experiments in a real labor market , 2010, ArXiv.

[38]  Robert C. Merton,et al.  The crisis in retirement planning , 2014 .

[39]  Joy M. Jacobs-Lawson,et al.  Psychological Foundations of Financial Planning for Retirement , 2007 .

[40]  Andrew Howes,et al.  Informing decisions: how people use online rating information to make choices , 2011, CHI.

[41]  Zoltán Gyöngyi,et al.  Social annotations in web search , 2012, CHI.

[42]  Martin Weber,et al.  The Role of Experience Sampling and Graphical Displays on One's Investment Risk Appetite , 2012, Manag. Sci..

[43]  Thomas Buser,et al.  The Flipside of Comparative Payment Schemes , 2014, Manag. Sci..

[44]  S. Milgram BEHAVIORAL STUDY OF OBEDIENCE. , 1963, Journal of abnormal psychology.

[45]  R. Cialdini Influence: Science and Practice , 1984 .

[46]  Sean A. Munson,et al.  Presenting diverse political opinions: how and how much , 2010, CHI.

[47]  Mary E. Thomson,et al.  The relative influence of advice from human experts and statistical methods on forecast adjustments , 2009 .

[48]  Gary Klein,et al.  Persuasive expert systems: the influence of confidence and discrepancy , 2000 .

[49]  Barry Smyth,et al.  Power to the people: exploring neighbourhood formations in social recommender system , 2011, RecSys '11.

[50]  Chris Arney Nudge: Improving Decisions about Health, Wealth, and Happiness , 2015 .

[51]  R. Thaler,et al.  Risk Aversion Or Myopia? Choices in Repeated Gambles and Retirement Investments , 1999 .

[52]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[53]  S. Mullainathan,et al.  The Market for Financial Advice: An Audit Study , 2012 .

[54]  Albert E. Mannes Are We Wise About the Wisdom of Crowds? The Use of Group Judgments in Belief Revision , 2009, Manag. Sci..

[55]  Edmund A. Mennis The Wisdom of Crowds: Why the Many Are Smarter than the Few and How Collective Wisdom Shapes Business, Economies, Societies, and Nations , 2006 .

[56]  C. Nass,et al.  Machines and Mindlessness , 2000 .

[57]  Aniket Kittur,et al.  Harnessing the wisdom of crowds in wikipedia: quality through coordination , 2008, CSCW.

[58]  D. Kahneman,et al.  Anomalies: The Endowment Effect, Loss Aversion, and Status Quo Bias , 1991 .

[59]  Katherine J. Stewart,et al.  How Hypertext Links Influence Consumer Perceptions to Build and Degrade Trust Online , 2006, J. Manag. Inf. Syst..

[60]  R. Thaler,et al.  Heuristics and Biases in Retirement Savings Behavior , 2007 .

[61]  J. Giles Internet encyclopaedias go head to head , 2005, Nature.

[62]  Oded Nov,et al.  Asymmetric Recommendations: The Interacting Effects of Social Ratings? Direction and Strength on Users' Ratings , 2015, RecSys.

[63]  Oded Nov,et al.  Influencing Retirement Saving Behavior with Expert Advice and Social Comparison as Persuasive Techniques , 2015, PERSUASIVE.

[64]  Kate Ehrlich,et al.  Taking advice from intelligent systems: the double-edged sword of explanations , 2011, IUI '11.

[65]  Florian Ederer,et al.  Understanding Mechanisms Underlying Peer Effects: Evidence from a Field Experiment on Financial Decisions , 2014 .

[66]  Hyla H. Polen,et al.  Scope, Completeness, and Accuracy of Drug Information in Wikipedia , 2008, The Annals of pharmacotherapy.

[67]  R. Kozinets,et al.  The Wisdom of Consumer Crowds , 2008 .

[68]  G. Gaus,et al.  Expert Political Judgment: How Good Is It? How Can We Know? , 2007, Perspectives on Politics.

[69]  Chinmay Kulkarni,et al.  All the news that's fit to read: a study of social annotations for news reading , 2013, CHI.

[70]  S. Bonaccio,et al.  Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences , 2006 .

[71]  M. Deutsch,et al.  A study of normative and informational social influences upon individual judgement. , 1955, Journal of abnormal psychology.

[72]  Richard H. Thaler,et al.  Behavioral Economics and the Retirement Savings Crisis , 2013, Science.

[73]  Andrew M. Hardin,et al.  Assessing the Credibility of Decisional Guidance Delivered by Information Systems , 2017, J. Manag. Inf. Syst..

[74]  Russ Ray,et al.  Prediction Markets and the Financial "Wisdom of Crowds" , 2006 .

[75]  H. Işıksal,et al.  The Impact Of Foreign Direct Investment On Turkish Economy 2010–2016 , 2017 .

[76]  Dan Ariely,et al.  When Retailing and Las Vegas Meet: Probabilistic Free Price Promotions , 2016, Manag. Sci..

[77]  Laura A. Dabbish,et al.  The Role of Social Influence in Security Feature Adoption , 2015, CSCW.

[78]  Annamaria Lusardi,et al.  Financial Literacy and Planning: Implications for Retirement Wellbeing , 2005 .

[79]  Benjamin Faubion Effect of Automated Advising Platforms on the Financial Advising Market , 2016 .

[80]  Alice H. Eagly,et al.  Heuristic and systematic information processing within and beyond the persuasion context. , 1989 .

[81]  Katherine L. Milkman,et al.  Holding the Hunger Games Hostage at the Gym: an Evaluation of Temptation Bundling , 2013, Manag. Sci..

[82]  Robert J. MacCoun,et al.  The benefits of knowing what you know (and what you don’t): How calibration affects credibility , 2008 .

[83]  Burton G. Malkiel,et al.  A Random Walk Down Wall Street: The Time-Tested Strategy for Successful Investing , 2020 .

[84]  O. Mitchell,et al.  Lifecycle Portfolio Choice with Systematic Longevity Risk and Variable Investment — Linked Deferred Annuities , 2011 .

[85]  Ed H. Chi,et al.  With a little help from my friends: examining the impact of social annotations in sensemaking tasks , 2009, CHI.

[86]  Gediminas Adomavicius,et al.  Context-aware recommender systems , 2008, RecSys '08.

[87]  H. Ling Dynamic Lifecycle Strategies for Target Date Retirement Funds , 2011 .

[88]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[89]  J. Powell,et al.  Primary care Health related virtual communities and electronic support groups : systematic review of the effects of online peer to peer interactions , 2004 .

[90]  Panagiotis G. Ipeirotis,et al.  Show me the money!: deriving the pricing power of product features by mining consumer reviews , 2007, KDD '07.

[91]  L. Edenbrandt,et al.  Acute myocardial infarction detected in the 12-lead ECG by artificial neural networks. , 1997, Circulation.

[92]  John Joseph Horton,et al.  The Condition of the Turking Class: Are Online Employers Fair and Honest? , 2010, ArXiv.

[93]  Panagiotis G. Ipeirotis Analyzing the Amazon Mechanical Turk marketplace , 2010, XRDS.

[94]  W. Pfau Lifecycle Funds and Wealth Accumulation for Retirement: Evidence for a More Conservative Asset Allocation as Retirement Approaches , 2009 .

[95]  Matthew J. Salganik,et al.  Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market , 2006, Science.

[96]  M. Drew,et al.  Portfolio Size Effect in Retirement Accounts: What Does It Imply for Lifecycle Asset Allocation Funds? , 2009, The Journal of Portfolio Management.

[97]  Oded Nov,et al.  Empowering Investors with Social Annotation When Saving for Retirement , 2017, CSCW.

[98]  Byungtae Lee,et al.  From the wisdom of crowds to my own judgment in microfinance through online peer-to-peer lending platforms , 2012, Electron. Commer. Res. Appl..

[99]  Chris Snijders,et al.  Operational risk assessments by supply chain professionals: Process and performance , 2013 .

[100]  R. Dawes Judgment under uncertainty: The robust beauty of improper linear models in decision making , 1979 .

[101]  Eva Chen,et al.  Identifying Expertise to Extract the Wisdom of Crowds , 2015, Manag. Sci..

[102]  Chanthika Pornpitakpan The Persuasiveness of Source Credibility: A Critical Review of Five Decades' Evidence , 2004 .

[103]  Shawndra Hill,et al.  Expert Stock Picker: The Wisdom of (Experts in) Crowds , 2011, Int. J. Electron. Commer..

[104]  Chia-Ying Li,et al.  Persuasive messages on information system acceptance: A theoretical extension of elaboration likelihood model and social influence theory , 2013, Comput. Hum. Behav..

[105]  Henry Been-Lirn Duh,et al.  To Risk or Not to Risk?: Improving Financial Risk Taking of Older Adults by Online Social Information , 2015, CSCW.

[106]  W. F. V. Raaij,et al.  Explaining customer experience of digital financial advice , 2017 .

[107]  S. Chaiken Heuristic versus systematic information processing and the use of source versus message cues in persuasion. , 1980 .

[108]  M. Pelster,et al.  Swarm Intelligence? Stock Opinions of the Crowd and Stock Returns , 2017, International Review of Economics & Finance.

[109]  Tom Fawcett,et al.  Data Science and its Relationship to Big Data and Data-Driven Decision Making , 2013, Big Data.

[110]  S. Einarsen,et al.  Destructive leadership behaviour: A definition and conceptual model. , 2007 .

[111]  John T. Cacioppo,et al.  The Elaboration Likelihood Model of Persuasion , 1986, Advances in Experimental Social Psychology.

[112]  Richard P. Larrick,et al.  The social psychology of the wisdom of crowds. , 2012 .

[113]  L. Richard Ye,et al.  The Impact of Explanation Facilities in User Acceptance of Expert System Advice , 1995, MIS Q..

[114]  Efraim Turban,et al.  What can crowdsourcing do for decision support? , 2014, Decis. Support Syst..

[115]  D. Helbing,et al.  How social influence can undermine the wisdom of crowd effect , 2011, Proceedings of the National Academy of Sciences.

[116]  Oded Nov,et al.  Informing and Improving Retirement Saving Performance using Behavioral Economics Theory-driven User Interfaces , 2015, CHI.

[117]  Richard P. Larrick,et al.  Intuitions About Combining Opinions: Misappreciation of the Averaging Principle , 2006, Manag. Sci..