Social learning strategies for matters of taste

Most choices people make are about “matters of taste” on which there is no universal, objective truth. Nevertheless, people can learn from the experiences of individuals with similar tastes who have already evaluated the available options—a potential harnessed by recommender systems. We mapped recommender system algorithms to models of human judgment and decision making about “matters of fact” and recast the latter as social learning strategies for “matters of taste.” Using computer simulations on a large-scale, empirical dataset, we studied how people could leverage the experiences of others to make better decisions. Our simulation showed that experienced individuals can benefit from relying mostly on the opinions of seemingly similar people; inexperienced individuals, in contrast, cannot reliably estimate similarity and are better off picking the mainstream option despite differences in taste. Crucially, the level of experience beyond which people should switch to similarity-heavy strategies varies substantially across individuals and depends on (i) how mainstream (or alternative) an individual’s tastes are and (ii) the level of dispersion in taste similarity with the other people in the group.

[1]  J. Torrey The standard of taste. , 1874 .

[2]  K. Gordon,et al.  Group judgments in the field of lifted weights. , 1924 .

[3]  J. Stroop Is the judgment of the group better than that of the average member of the group , 1932 .

[4]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[5]  K. R. Hammond,et al.  ANALYZING THE COMPONENTS OF CLINICAL INFERENCE. , 1964, Psychological review.

[6]  T. Brock,et al.  COMMUNICATOR-RECIPIENT SIMILARITY AND DECISION CHANGE. , 1965, Journal of personality and social psychology.

[7]  J. M. Bates,et al.  The Combination of Forecasts , 1969 .

[8]  H. Simons,et al.  Similarity, credibility, and attitude change: A review and a theory. , 1970 .

[9]  Joel B. Cohen,et al.  Informational Social Influence and Product Evaluation. , 1972 .

[10]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[11]  R. E. Burnkrant,et al.  Informational and Normative Social Influence in Buyer Behavior , 1975 .

[12]  R. Hogarth,et al.  Unit weighting schemes for decision making , 1975 .

[13]  Robin M. Hogarth,et al.  Quality of Group Judgment , 1977 .

[14]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[15]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[16]  Robin M. Hogarth,et al.  A note on aggregating opinions , 1978 .

[17]  Elaine Rich,et al.  User Modeling via Stereotypes , 1998, Cogn. Sci..

[18]  R. Dawes Judgment under uncertainty: The robust beauty of improper linear models in decision making , 1979 .

[19]  M. Feldman,et al.  Cultural transmission and evolution: a quantitative approach. , 1981, Monographs in population biology.

[20]  S. Feld Social Structural Determinants of Similarity among Associates , 1982 .

[21]  Philip Yetton,et al.  Individual versus group problem solving: An empirical test of a best-member strategy , 1982 .

[22]  C. Lumsden Culture and the Evolutionary Process, Robert Boyd, Peter J. Richerson. University of Chicago Press, Chicago & London (1985), viii, +301. Price $29.95 , 1986 .

[23]  Stephen J. Hoch,et al.  An Anchoring and Adjustment Model of Spousal Predictions , 1986 .

[24]  Jack L. Treynor Market Efficiency and the Bean Jar Experiment , 1987 .

[25]  D. Wayne Osgood,et al.  Influence and Similarity Among Friends: An Integrative Model Applied to Incarcerated Adolescents , 1989 .

[26]  R. Clemen Combining forecasts: A review and annotated bibliography , 1989 .

[27]  G. Gigerenzer From Tools to Theories: A Heuristic of Discovery in Cognitive Psychology. , 1991 .

[28]  R. Nosofsky Similarity Scaling and Cognitive Process Models , 1992 .

[29]  N. Altman An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression , 1992 .

[30]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[31]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[32]  Glenn Ellison,et al.  Rules of Thumb for Social Learning , 1993, Journal of Political Economy.

[33]  L. Thurstone A law of comparative judgment. , 1994 .

[34]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[35]  Thomas G. Dietterich,et al.  Error-Correcting Output Coding Corrects Bias and Variance , 1995, ICML.

[36]  Pattie Maes,et al.  Social information filtering: algorithms for automating “word of mouth” , 1995, CHI '95.

[37]  P. M. West Predicting Preferences: An Examination of Agent Learning , 1996 .

[38]  Robert Tibshirani,et al.  Bias, Variance and Prediction Error for Classification Rules , 1996 .

[39]  Leo Breiman,et al.  Bias, Variance , And Arcing Classifiers , 1996 .

[40]  Ron Kohavi,et al.  Bias Plus Variance Decomposition for Zero-One Loss Functions , 1996, ICML.

[41]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[42]  A. Gopnik,et al.  Early reasoning about desires: evidence from 14- and 18-month-olds. , 1997, Developmental psychology.

[43]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[44]  L. Breiman Arcing Classifiers , 1998 .

[45]  L. Breiman Arcing classifier (with discussion and a rejoinder by the author) , 1998 .

[46]  John Riedl,et al.  An algorithmic framework for performing collaborative filtering , 1999, SIGIR '99.

[47]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[48]  Arthur E. Hoerl,et al.  Ridge Regression: Biased Estimation for Nonorthogonal Problems , 2000, Technometrics.

[49]  John Riedl,et al.  Application of Dimensionality Reduction in Recommender System - A Case Study , 2000 .

[50]  A. E. Hoerl,et al.  Ridge regression: biased estimation for nonorthogonal problems , 2000 .

[51]  Peter Brusilovsky,et al.  User modeling and user adapted interaction , 2001 .

[52]  M. McPherson,et al.  Birds of a Feather: Homophily in Social Networks , 2001 .

[53]  Rashmi R. Sinha,et al.  Comparing Recommendations Made by Online Systems and Friends , 2001, DELOS.

[54]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[55]  Magnus Persson,et al.  PROBabilities from EXemplars (PROBEX): a "lazy" algorithm for probabilistic inference from generic knowledge , 2002, Cogn. Sci..

[56]  I. J. Myung,et al.  When a good fit can be bad , 2002, Trends in Cognitive Sciences.

[57]  Maarten van Someren,et al.  A Bias-Variance Analysis of a Real World Learning Problem: The CoIL Challenge 2000 , 2004, Machine Learning.

[58]  Gareth James,et al.  Variance and Bias for General Loss Functions , 2003, Machine Learning.

[59]  Robin D. Burke,et al.  Hybrid Recommender Systems: Survey and Experiments , 2002, User Modeling and User-Adapted Interaction.

[60]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[61]  K. Laland Social learning strategies , 2004, Learning & behavior.

[62]  Kenneth Y. Goldberg,et al.  Eigentaste: A Constant Time Collaborative Filtering Algorithm , 2001, Information Retrieval.

[63]  Robyn M. Dawes,et al.  The Superiority of Simple Alternatives to Regression for Social Science Predictions , 2004 .

[64]  Robin M. Hogarth,et al.  Ignoring information in binary choice with continuous variables: When is less “more”? , 2005 .

[65]  Lior Rokach,et al.  Data Mining And Knowledge Discovery Handbook , 2005 .

[66]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[67]  Reid Hastie,et al.  The robust beauty of majority rules in group decisions. , 2005, Psychological review.

[68]  Martin H. Levinson Not by Genes Alone: How Culture Transformed Human Evolution , 2006 .

[69]  Michael J. Pazzani,et al.  Content-Based Recommendation Systems , 2007, The Adaptive Web.

[70]  Alfred Kobsa,et al.  The Adaptive Web, Methods and Strategies of Web Personalization , 2007, The Adaptive Web.

[71]  Persi Diaconis,et al.  c ○ 2007 Society for Industrial and Applied Mathematics Dynamical Bias in the Coin Toss ∗ , 2022 .

[72]  Yehuda Koren,et al.  Lessons from the Netflix prize challenge , 2007, SKDD.

[73]  Joseph A. Konstan,et al.  Who predicts better?: results from an online study comparing humans and an online recommender system , 2008, RecSys '08.

[74]  P. Todd,et al.  Predicting children's meal preferences: How much do parents know? , 2008, Appetite.

[75]  F. Gino,et al.  The impact of information from similar or different advisors on judgment , 2009 .

[76]  Gerd Gigerenzer,et al.  Homo Heuristicus: Why Biased Minds Make Better Inferences , 2009, Top. Cogn. Sci..

[77]  Timothy D. Wilson,et al.  The Surprising Power of Neighborly Advice , 2009, Science.

[78]  Stefan M. Herzog,et al.  The Wisdom of Many in One Mind , 2009, Psychological science.

[79]  Sylvain Arlot,et al.  A survey of cross-validation procedures for model selection , 2009, 0907.4728.

[80]  Mark P. Graus,et al.  Understanding choice overload in recommender systems , 2010, RecSys '10.

[81]  David V. Budescu,et al.  Why recognition is rational: Optimality results on single-variable decision rules , 2010, Judgment and Decision Making.

[82]  Christine Fawcett,et al.  Children reason about shared preferences. , 2010, Developmental psychology.

[83]  Pierre Geurts,et al.  Bias vs Variance Decomposition for Regression and Classification , 2005, Data Mining and Knowledge Discovery Handbook.

[84]  Ashutosh Kumar Singh,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2010 .

[85]  A. Hama,et al.  How Many Friends Does One Person Need? Dunbar's Number and Other Evolutionary Quirks , 2011 .

[86]  Jacob Feldman,et al.  Conceptual complexity and the bias/variance tradeoff , 2011, Cognition.

[87]  Ilan Yaniv,et al.  Receiving advice on matters of taste: Similarity, majority influence, and taste discrimination , 2011 .

[88]  K. Laland,et al.  Cognitive culture: theoretical and empirical insights into social learning strategies , 2011, Trends in Cognitive Sciences.

[89]  Konstantinos V. Katsikopoulos,et al.  Psychological Heuristics for Making Inferences: Definition, Performance, and the Emerging Theory and Practice , 2011, Decis. Anal..

[90]  George Karypis,et al.  A Comprehensive Survey of Neighborhood-based Recommendation Methods , 2011, Recommender Systems Handbook.

[91]  Scott Fortmann-Roe,et al.  Understanding the bias-variance tradeoff , 2012 .

[92]  Richard P. Larrick,et al.  The social psychology of the wisdom of crowds. , 2012 .

[93]  Sophie Ahrens,et al.  Recommender Systems , 2012 .

[94]  Rong Hu,et al.  Personality-based recommender systems: an overview , 2012, RecSys.

[95]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[96]  Robert L. Goldstone,et al.  Learning Along With Others , 2013 .

[97]  Mehrbakhsh Nilashi,et al.  Collaborative filtering recommender systems , 2013 .

[98]  R. Hertwig,et al.  The ecological validity of fluency , 2013 .

[99]  Özgür Simsek,et al.  Linear decision rule as aspiration for simple decision heuristics , 2013, NIPS.

[100]  F. Maxwell Harper,et al.  User perception of differences in recommender algorithms , 2014, RecSys '14.

[101]  A. Culyer Thurstone’s Law of Comparative Judgment , 2014 .

[102]  Richard P. Larrick,et al.  The wisdom of select crowds. , 2014, Journal of personality and social psychology.

[103]  Konstantinos V. Katsikopoulos,et al.  Multi-attribute utility models as cognitive search engines , 2014, Judgment and Decision Making.

[104]  David V. Budescu,et al.  When is a crowd wise? , 2014, ArXiv.

[105]  Weiqiang Dong On Bias , Variance , 0 / 1-Loss , and the Curse of Dimensionality RK April 13 , 2014 .

[106]  Sihai Dave Zhao,et al.  Más-o-menos: a simple sign averaging method for discrimination in genomic data analysis , 2014, Bioinform..

[107]  Stefan M. Herzog,et al.  Harnessing the wisdom of the inner crowd , 2014, Trends in Cognitive Sciences.

[108]  R. Preston McAfee,et al.  The wisdom of smaller, smarter crowds , 2014, EC.

[109]  Sydney E. Scott,et al.  Psychological Strategies for Winning a Geopolitical Forecasting Tournament , 2014, Psychological science.

[110]  Timothy D. Wilson,et al.  Predicting what we will like: Asking a stranger can be as good as asking a friend , 2015 .

[111]  Marcus Buckmann,et al.  Learning From Small Samples: An Analysis of Simple Decision Heuristics , 2015, NIPS.

[112]  Dan Cosley,et al.  Studying and Modeling the Connection between People's Preferences and Content Sharing , 2015, CSCW.

[113]  Marcus Buckmann,et al.  On Learning Decision Heuristics , 2017, IDM@NIPS.

[114]  Iván Cantador,et al.  Alleviating the new user problem in collaborative filtering by exploiting personality information , 2016, User Modeling and User-Adapted Interaction.

[115]  Thorsten Joachims,et al.  Recommendations as Treatments: Debiasing Learning and Evaluation , 2016, ICML.

[116]  Gary Lupyan,et al.  Discovering Psychological Principles by Mining Naturally Occurring Data Sets , 2016, Top. Cogn. Sci..

[117]  Shanping Li,et al.  Where is the crowd , 2017 .

[118]  Hyowon Gweon,et al.  Learning the Structure of Social Influence. , 2017, Cognitive science.

[119]  Alexandra Paxton,et al.  Finding the traces of behavioral and cognitive processes in big data and naturally occurring datasets , 2017, Behavior Research Methods.

[120]  Stefan M. Herzog,et al.  Strategy Selection Versus Strategy Blending: A Predictive Perspective on Single‐ and Multi‐Strategy Accounts in Multiple‐Cue Estimation , 2018 .

[121]  Ilan Yaniv,et al.  The Wisdom of Crowds in Matters of Taste , 2017, Manag. Sci..

[122]  Jon Kleinberg,et al.  Making sense of recommendations , 2019, Journal of Behavioral Decision Making.