Computational Models for the Combination of Advice and Individual Learning

Decision making often takes place in social environments where other actors influence individuals' decisions. The present article examines how advice affects individual learning. Five social learning models combining advice and individual learning-four based on reinforcement learning and one on Bayesian learning-and one individual learning model are tested against each other. In two experiments, some participants received good or bad advice prior to a repeated multioption choice task. Receivers of advice adhered to the advice, so that good advice improved performance. The social learning models described the observed learning processes better than the individual learning model. Of the models tested, the best social learning model assumes that outcomes from recommended options are more positively evaluated than outcomes from nonrecommended options. This model correctly predicted that receivers first adhere to advice, then explore other options, and finally return to the recommended option. The model also predicted accurately that good advice has a stronger impact on learning than bad advice. One-time advice can have a long-lasting influence on learning by changing the subjective evaluation of outcomes of recommended options.

[1]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[2]  Zucchini,et al.  An Introduction to Model Selection. , 2000, Journal of mathematical psychology.

[3]  L. Festinger A Theory of Social Comparison Processes , 1954 .

[4]  Karl H. Schlag,et al.  Which One Should I Imitate , 1999 .

[5]  Ilan Yaniv,et al.  Receiving Other People's Advice: Influence and Benefit , 2004 .

[6]  Elke U. Weber,et al.  Beyond a Trait View of Risk Taking: A Domain-Specific Scale Measuring Risk Perceptions, Expected Benefits, and Perceived-Risk Attitudes in German-Speaking Populations , 2004 .

[7]  I. Erev,et al.  On adaptation, maximization, and reinforcement learning among cognitive strategies. , 2005, Psychological review.

[8]  Timothy M. Waring,et al.  Article in Press Evolution and Human Behavior Xxx (2005) Xxx – Xxx , 2022 .

[9]  Charles A. Holt,et al.  Risk Aversion and Incentive Effects , 2002 .

[10]  Barry Sopher,et al.  Social Learning and Coordination Conventions in Intergenerational Games: An Experimental Study , 2003, Journal of Political Economy.

[11]  A. Damasio,et al.  Insensitivity to future consequences following damage to human prefrontal cortex , 1994, Cognition.

[12]  R. Boyd,et al.  The evolution of conformist transmission and the emergence of between-group differences. , 1998 .

[13]  K. Schlag Why Imitate, and If So, How?, : A Boundedly Rational Approach to Multi-armed Bandits , 1998 .

[14]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[15]  A. Roth,et al.  Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria , 1998 .

[16]  Frederick Mosteller,et al.  Stochastic Models for Learning , 1956 .

[17]  Noah Gans,et al.  Simple Models of Discrete Choice and Their Performance in Bandit Experiments , 2007, Manuf. Serv. Oper. Manag..

[18]  Shenghua Luan,et al.  Weighting Information from Outside Sources: A Biased Process , 2004 .

[19]  Adrian K. Rantilla,et al.  Confidence in aggregation of expert opinions. , 2000, Acta psychologica.

[20]  Colin Camerer,et al.  Experience‐weighted Attraction Learning in Normal Form Games , 1999 .

[21]  Ilan Yaniv,et al.  The Benefit of Additional Opinions , 2004 .

[22]  Ted L. Rosenthal,et al.  Observational learning of rule-governed behavior by children. , 1974 .

[23]  James L. McClelland,et al.  A reexamination of the evidence for the somatic marker hypothesis: what participants really know in the Iowa gambling task. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[24]  J. Henrich,et al.  The evolution of cultural evolution , 2003 .

[25]  J. Rieskamp Positive and negative recency effects in retirement savings decisions. , 2006, Journal of experimental psychology. Applied.

[26]  I. Erev,et al.  LEARNING STRATEGIES , 2010 .

[27]  W. Estes,et al.  Risks of drawing inferences about cognitive processes from model fits to individual versus average performance , 2005, Psychonomic bulletin & review.

[28]  J. Rieskamp,et al.  SSL: a theory of how people learn to select strategies. , 2006, Journal of experimental psychology. General.

[29]  Samuel M. McClure,et al.  Neural Correlates of Behavioral Preference for Culturally Familiar Drinks , 2004, Neuron.

[30]  F. Murray Multiple probable situation: A study of a five one-armed bandit problem , 1971 .

[31]  S. Thompson Social Learning Theory , 2008 .

[32]  E. Weber,et al.  A Domain-Specific Risk-Attitude Scale: Measuring Risk Perceptions and Risk Behaviors , 2002 .

[33]  Robert J. Meyer,et al.  Dynamic decision making: Optimal policies and actual behavior in sequential choice problems , 1994 .

[34]  Jörg Rieskamp,et al.  How do people learn to allocate resources? Comparing two learning theories. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[35]  R. Gonzalez,et al.  When Words Speak Louder Than Actions: Another's Evaluations Can Appear More Diagnostic Than Their Decisions , 1994 .

[36]  Andrew Schotter,et al.  An Experimental Test of Advice and Social Learning , 2010, Manag. Sci..

[37]  Eldad Yechiam,et al.  Comparison of basic assumptions embedded in learning models for experience-based decision making , 2005, Psychonomic bulletin & review.

[38]  G. Miller,et al.  Cognitive science. , 1981, Science.

[39]  J. Busemeyer,et al.  Model Comparisons and Model Selections Based on Generalization Criterion Methodology. , 2000, Journal of mathematical psychology.

[40]  Sharon K. Gibson Social Learning (Cognitive) Theory and Implications for Human Resource Development , 2004 .

[41]  Ido Erev Signal detection by human observers: a cutoff reinforcement learning model of categorization decisions under uncertainty. , 1998 .

[42]  Daisuke Nakanishi,et al.  Does social/cultural learning increase human adaptability?: Rogers's question revisited , 2003 .

[43]  Jerker Denrell,et al.  Why most people disapprove of me: experience sampling in impression formation. , 2005, Psychological review.

[44]  R. Hertwig,et al.  Decisions from Experience and the Effect of Rare Events in Risky Choice , 2004, Psychological science.

[45]  I. Erev,et al.  Small feedback‐based decisions and their limited correspondence to description‐based decisions , 2003 .

[46]  Jörg Oechssler,et al.  Imitation - Theory and Experimental Evidence , 2003, J. Econ. Theory.

[47]  Teck-Hua Ho,et al.  Sophisticated Experience-Weighted Attraction Learning and Strategic Teaching in Repeated Games , 2002, J. Econ. Theory.

[48]  N. Miller,et al.  Social Learning and Imitation , 1942 .

[49]  M. Keane,et al.  Decision-Making Under Uncertainty: Capturing Dynamic Brand Choice Processes in Turbulent Consumer Goods Markets , 1996 .

[50]  D. Stahl Boundedly rational rule learning in a guessing game , 1996 .

[51]  T. Rosenthal,et al.  Social Learning and Cognition , 1978 .

[52]  I. J. Myung,et al.  An Adaptive Approach to Human Decision Making : Learning Theory , Decision Theory , and Human Performance , 2004 .

[53]  John Cohen Social Learning and Imitation , 1945, Nature.

[54]  Jörg Rieskamp,et al.  Perspectives of probabilistic inferences: Reinforcement learning and an adaptive network compared. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[55]  P. Richerson,et al.  Culture and the Evolutionary Process , 1988 .

[56]  R. Meyer,et al.  Sequential Choice Under Ambiguity: Intuitive Solutions to the Armed-Bandit Problem , 1995 .

[57]  A. Schotter,et al.  Words Speak Louder than Actions and Improve Welfare: An Experimental Test of Advice and Social Learning , 2005 .

[58]  H. Simon,et al.  A mechanism for social selection and successful altruism. , 1990, Science.

[59]  J. Busemeyer,et al.  A contribution of cognitive decision models to clinical assessment: decomposing performance on the Bechara gambling task. , 2002, Psychological assessment.

[60]  Yaniv,et al.  Advice Taking in Decision Making: Egocentric Discounting and Reputation Formation. , 2000, Organizational behavior and human decision processes.

[61]  Jerome R. Busemeyer,et al.  An adaptive approach to human decision making: Learning theory, decision theory, and human performance. , 1992 .

[62]  W. Estes Toward a Statistical Theory of Learning. , 1994 .

[63]  Daisuke Nakanishi,et al.  Cost–benefit analysis of social/cultural learning in a nonstationary uncertain environment: An evolutionary simulation and an experiment with human subjects , 2002 .

[64]  Nir Vulkan An Economist's Perspective on Probability Matching , 2000 .

[65]  D. Shanks,et al.  A Re-examination of Probability Matching and Rational Choice , 2002 .

[66]  Andrew N. Meltzoff,et al.  The neural bases of cooperation and competition: an fMRI investigation , 2004, NeuroImage.

[67]  Andreas Roider,et al.  Herding with and Without Payoff Externalities - an Internet Experiment , 2004 .