Making better decisions in groups

We review the literature to identify common problems of decision-making in individuals and groups. We are guided by a Bayesian framework to explain the interplay between past experience and new evidence, and the problem of exploring the space of hypotheses about all the possible states that the world could be in and all the possible actions that one could take. There are strong biases, hidden from awareness, that enter into these psychological processes. While biases increase the efficiency of information processing, they often do not lead to the most appropriate action. We highlight the advantages of group decision-making in overcoming biases and searching the hypothesis space for good models of the world and good solutions to problems. Diversity of group members can facilitate these achievements, but diverse groups also face their own problems. We discuss means of managing these pitfalls and make some recommendations on how to make better group decisions.

[1]  R. Dolan,et al.  Metacognition: computation, biology and function , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[2]  I. Janis.  Groupthink: Psychological Studies of Policy Decisions and Fiascoes , 1982 .

[3]  S. Harkins,et al.  Social loafing and group evaluation. , 1989 .

[4]  Albert Van Helden,et al.  “Annulo Cingitur”: The Solution of the Problem of Saturn , 1974 .

[5]  Helmut Lamm,et al.  A Review of Our Research on Group Polarization: Eleven Experiments on the Effects of Group Discussion on Risk Acceptance, Probability Estimation, and Negotiation Positions , 1988 .

[6]  M. Billig,et al.  Risky shifts, cautious shifts, and group polarization , 1971 .

[7]  P. Dayan,et al.  Model-based and model-free Pavlovian reward learning: Revaluation, revision, and revelation , 2014, Cognitive, affective & behavioral neuroscience.

[8]  Matthias Sutter,et al.  Teams Make You Smarter: How Exposure to Teams Improves Individual Decisions in Probability and Reasoning Tasks , 2013 .

[9]  A. Koriat,et al.  When Are Two Heads Better than One and Why? , 2012, Science.

[10]  Robert D. Sorkin,et al.  Group Performance Depends on the Majority Rule , 1998 .

[11]  Jeffrey T. Polzer,et al.  Capitalizing on Diversity: Interpersonal Congruence in Small Work Groups , 2001 .

[12]  Christian H. Jordan,et al.  Birds of a Feather Sit Together: Physical Similarity Predicts Seating Choice , 2011, Personality & social psychology bulletin.

[13]  D. Prelec.  A Bayesian Truth Serum for Subjective Data , 2004, Science.

[14]  M. Sigman,et al.  Individual consistency in the accuracy and distribution of confidence judgments , 2016, Cognition.

[15]  C. Frith,et al.  Dual-process theories and consciousness: the case for ‘Type Zero’ cognition , 2016, Neuroscience of consciousness.

[16]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[17]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[18]  C. Heyes,et al.  Supra-personal cognitive control and metacognition , 2014, Trends in Cognitive Sciences.

[19]  I. Couzin,et al.  Emergent Sensing of Complex Environments by Mobile Animal Groups , 2013, Science.

[20]  G. Stasser,et al.  Expert Roles and Information Exchange during Discussion: The Importance of Knowing Who Knows What , 1995 .

[21]  Robert A. Neimeyer,et al.  Similarity and Attraction: A Longitudinal Study , 1988 .

[22]  Thomas L. Griffiths,et al.  Algorithms to Live By: The Computer Science of Human Decisions , 2016 .

[23]  J. Glover,et al.  The incidence of tonsillectomy in school children , 1938, Proceedings of the Royal Society of Medicine.

[24]  Peter van den Besselaar,et al.  The selection of talent as a group process. A literature review on the social dynamics of decision making in grant panels , 2014 .

[25]  D. Moore,et al.  The trouble with overconfidence. , 2008, Psychological review.

[26]  Colin G. DeYoung,et al.  Neurotic Individuals are not Creative Thinkers , 2016, Trends in Cognitive Sciences.

[27]  C. Frith,et al.  Coming to Terms , 2012, Psychological science.

[28]  Jens Krause,et al.  Detection Accuracy of Collective Intelligence Assessments for Skin Cancer Diagnosis. , 2015, JAMA dermatology.

[29]  Paul C. Burnett,et al.  Cross-cultural differences in self-reported decision-making style and confidence , 1998 .

[30]  K. Williams,et al.  Social Loafing and Swimming: Effects of Identifiability on Individual and Relay Performance of Intercollegiate Swimmers , 1989 .

[31]  J. Hoffecker,et al.  The Information Animal and the Super-brain , 2013 .

[32]  D. Bem,et al.  Group influence on individual risk taking. , 1962, Journal of abnormal and social psychology.

[33]  Emmanuel Trouche,et al.  Arguments, more than confidence, explain the good performance of reasoning groups. , 2014, Journal of experimental psychology. General.

[34]  Stefan Krause,et al.  Swarm intelligence in animals and humans. , 2010, Trends in ecology & evolution.

[35]  Kipling D. Williams,et al.  Interpersonal Relations and Group Processes Social Loafing: a Meta-analytic Review and Theoretical Integration , 2022 .

[36]  Michael Vitale,et al.  The Wisdom of Crowds , 2015, Cell.

[37]  James L. Farr,et al.  Incentive schedules, productivity, and satisfaction in work groups: A laboratory study☆ , 1976 .

[38]  K. Sakai,et al.  Autonomous Mechanism of Internal Choice Estimate Underlies Decision Inertia , 2014, Neuron.

[39]  J. O'Doherty,et al.  Behavioral contagion during learning about another agent’s risk-preferences acts on the neural representation of decision-risk , 2016, Proceedings of the National Academy of Sciences.

[40]  D. Budescu,et al.  Averaging probability judgments: Monte Carlo analyses of asymptotic diagnostic value , 2001 .

[41]  Catherine A. Hartley,et al.  From Creatures of Habit to Goal-Directed Learners , 2016, Psychological science.

[42]  Nigel Harvey,et al.  Confidence in judgment , 1997, Trends in Cognitive Sciences.

[43]  R. Brook,et al.  How coronary angiography is used. Clinical determinants of appropriateness. , 1987, JAMA.

[44]  G. Gaus,et al.  Expert Political Judgment: How Good Is It? How Can We Know? , 2007, Perspectives on Politics.

[45]  C. Leaper,et al.  Meta-Analyses of Gender Effects on Conversational Interruption: Who, What, When, Where, and How , 1998 .

[46]  G. Goethals,et al.  Presidential leadership. , 2005, Annual review of psychology.

[47]  Pascal Huguet,et al.  Productivity Loss in Performance Groups : People Who See Themselves as Average Do Not Engage in ' Social Loafing , 2004 .

[48]  P. Croskerry,et al.  Profiles in patient safety: authority gradients in medical error. , 2004, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[49]  G Hertel,et al.  Motivation gains in performance groups: paradigmatic and theoretical developments on the Köhler effect. , 2000, Journal of personality and social psychology.

[50]  Peter Dayan,et al.  Decision-Theoretic Psychiatry , 2015 .

[51]  Noah J. Goldstein,et al.  Social influence: compliance and conformity. , 2004, Annual review of psychology.

[52]  S. Ng,et al.  Interruption and Influence in Discussion Groups , 1995 .

[53]  Zubair Nabi.  R̶e̶s̶i̶s̶t̶a̶n̶c̶e̶ censorship is futile , 2014 .

[54]  Guido Hertel,et al.  Motivation gains of inferior group members: a meta-analytical review. , 2007, Journal of personality and social psychology.

[55]  Maja O’Connor.  LONGITUDINAL STUDY , 2013 .

[56]  David Moshman Molly Geil,et al.  Collaborative Reasoning: Evidence for Collective Rationality , 1998 .

[57]  Gordon D. A. Brown,et al.  Does the brain calculate value? , 2011, Trends in Cognitive Sciences.

[58]  Nicholas Epley,et al.  Group discussion improves lie detection , 2015, Proceedings of the National Academy of Sciences.

[59]  Suraje Dessai,et al.  Communicating uncertainty in seasonal and interannual climate forecasts in Europe , 2015, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[60]  G. Stasser,et al.  Pooling of Unshared Information in Group Decision Making: Biased Information Sampling During Discussion , 1985 .

[61]  I. Couzin.  Collective cognition in animal groups , 2009, Trends in Cognitive Sciences.

[62]  T. Sharot.  The optimism bias , 2011, Current Biology.

[63]  Dariusz Plewczynski,et al.  Information-sharing and aggregation models for interacting minds , 2011, ArXiv.

[64]  N. B. Cottrell,et al.  Social facilitation of dominant responses by the presence of an audicence and the mere presence of others. , 1968, Journal of personality and social psychology.

[65]  P. Tetlock,et al.  Social and cognitive strategies for coping with accountability: conformity, complexity, and bolstering. , 1989, Journal of personality and social psychology.

[66]  S. Bikhchandani,et al.  You have printed the following article : A Theory of Fads , Fashion , Custom , and Cultural Change as Informational Cascades , 2007 .

[67]  R. Gallupe,et al.  Some Liberating Effects of Anonymous Electronic Brainstorming , 1998 .

[68]  Nicole M. Long,et al.  Supplemental Figure , 2013 .

[69]  Harry Nussbaumer,et al.  Einstein's conversion from his static to an expanding universe , 2013 .

[70]  Sigal G. Barsade.  The Ripple Effect: Emotional Contagion and its Influence on Group Behavior , 2002 .

[71]  C. Frith,et al.  Equality bias impairs collective decision-making across cultures , 2015, Proceedings of the National Academy of Sciences.

[72]  Glenn E. Littlepage,et al.  An input-process-output analysis of influence and performance in problem-solving groups. , 1995 .

[73]  H. Sebastian Seung,et al.  A solution to the single-question crowd wisdom problem , 2017, Nature.

[74]  H. Mercier.  The Argumentative Theory: Predictions and Empirical Evidence , 2016, Trends in Cognitive Sciences.

[75]  Kenji Hakuta,et al.  Effects of Racial Diversity on Complex Thinking in College Students , 2004, Psychological science.

[76]  P. R. Laughlin,et al.  Groups perform better than the best individuals on letters-to-numbers problems: effects of group size. , 2006, Journal of personality and social psychology.

[77]  Nick Chater,et al.  Herding in humans , 2009, Trends in Cognitive Sciences.

[78]  David A. Kravitz,et al.  Ringelmann rediscovered: the original article , 1986 .

[79]  Brad M. Barber,et al.  Boys Will Be Boys: Gender, Overconfidence, and Common Stock Investment , 1998 .

[80]  Gerd Gigerenzer,et al.  Why Heuristics Work , 2008, Perspectives on psychological science : a journal of the Association for Psychological Science.

[81]  L. Cosmides,et al.  Evolutionary psychology: new perspectives on cognition and motivation. , 2013, Annual review of psychology.

[82]  R. Dick,et al.  Recognizing the benefits of diversity: When and how does diversity increase group performance? , 2010 .

[83]  Vichita Vathanophas,et al.  Task-related Information Sharing in Group Decision Support Systems (GDSS) The Importance of Knowing Who Knows What , 2011 .

[84]  E. Wagenmakers,et al.  Why psychologists must change the way they analyze their data: the case of psi: comment on Bem (2011). , 2011, Journal of personality and social psychology.

[85]  Eleanor C. Main,et al.  Choice Shifts and Extreme Behavior: Judicial Review in the Federal Courts , 1973 .

[86]  Melissa S. Kearney,et al.  State Lotteries and Consumer Behavior , 2002 .

[87]  M. Johnson,et al.  Circulating microRNAs in Sera Correlate with Soluble Biomarkers of Immune Activation but Do Not Predict Mortality in ART Treated Individuals with HIV-1 Infection: A Case Control Study , 2015, PloS one.

[88]  Adam N. Sanborn,et al.  Bayesian Brains without Probabilities , 2016, Trends in Cognitive Sciences.

[89]  Michael Shermer.  Psychic drift. Why most scientists do not believe in ESP and psi phenomena. , 2003, Scientific American.

[90]  G. Gigerenzer,et al.  Probabilistic mental models: a Brunswikian theory of confidence. , 1991, Psychological review.

[91]  P. R. Laughlin,et al.  Collective Induction: Twelve Postulates. , 1999, Organizational behavior and human decision processes.

[92]  P. Devine,et al.  The active control of prejudice: unpacking the intentions guiding control efforts. , 2009, Journal of personality and social psychology.

[93]  H Gu,et al.  The effects of averaging subjective probability estimates between and within judges. , 2000, Journal of experimental psychology. Applied.

[94]  N. Daw,et al.  Reinforcement Learning and Episodic Memory in Humans and Animals: An Integrative Framework , 2017, Annual review of psychology.

[95]  K. Williams,et al.  Many Hands Make Light the Work: The Causes and Consequences of Social Loafing , 1979 .

[96]  J. Scott Armstrong,et al.  University of Pennsylvania Scholarlycommons Comparing Face-to-face Meetings, Nominal Groups, Delphi and Prediction Markets on an Estimation Task Comparing Face-to-face Meetings, Nominal Groups, Delphi and Prediction Markets on an Estimation Task Comparing Face-to-face Meetings, Nominal Groups, Delph , 2022 .

[97]  Sniezek,et al.  The Social Influence of Confidence in Group Decision Making , 1997, Journal of experimental social psychology.

[98]  Stefan M. Herzog,et al.  Boosting medical diagnostics by pooling independent judgments , 2016, Proceedings of the National Academy of Sciences.

[99]  Angela J. Yu,et al.  Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[100]  Scott E. Page,et al.  Problem Solving by Heterogeneous Agents , 2001, J. Econ. Theory.

[101]  Richard P. Heitz,et al.  The speed-accuracy tradeoff: history, physiology, methodology, and behavior , 2014, Front. Neurosci..

[102]  L. Ross,et al.  Objectivity in the eye of the beholder: divergent perceptions of bias in self versus others. , 2004, Psychological review.

[103]  Timothy D. Wilson,et al.  The Future Is Now: Temporal Correction in Affective Forecasting☆ , 2002 .

[104]  Zubair Nabi.  Censorship is Futile , 2014, ArXiv.

[105]  Lorna Hutson,et al.  Where and How , 2015 .

[106]  An Analysis of Decision Under Risk in Rats , 2018 .

[107]  P. Tetlock,et al.  Accounting for the effects of accountability. , 1999, Psychological bulletin.

[108]  Engin Bozdag,et al.  Bias in algorithmic filtering and personalization , 2013, Ethics and Information Technology.

[109]  M. J. Bayarri,et al.  Optimal Reporting of Predictions , 1989 .

[110]  Wim H. Gijselaers,et al.  Common Ground, Complex Problems and Decision Making , 2006 .

[111]  P. Latham,et al.  Confidence matching in group decision-making , 2017, Nature Human Behaviour.

[112]  D. Wolpert.  Probabilistic models in human sensorimotor control. , 2007, Human movement science.

[113]  A. Pouget,et al.  Probabilistic brains: knowns and unknowns , 2013, Nature Neuroscience.

[114]  N. Dalkey,et al.  An Experimental Application of the Delphi Method to the Use of Experts , 1963 .

[115]  F. Ratnieks.  Honeybee Democracy Thomas D. Seeley Honeybee Democracy , 2011, Animal Behaviour.

[116]  József Fiser,et al.  Neural Variability and Sampling-Based Probabilistic Representations in the Visual Cortex , 2016, Neuron.

[117]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[118]  Lu Hong,et al.  Groups of diverse problem solvers can outperform groups of high-ability problem solvers. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[119]  David G. Myers,et al.  Group-Induced Polarization in Simulated Juries , 1976 .

[120]  Laurence T. Hunt,et al.  Approach-Induced Biases in Human Information Sampling , 2016, bioRxiv.

[121]  J. Kruger,et al.  Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments. , 1999, Journal of personality and social psychology.

[122]  D. Sumpter.  The principles of collective animal behaviour , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[123]  Daniel L. Schwartz,et al.  The Emergence of Abstract Representations in Dyad Problem Solving , 1995 .

[124]  L. Levin,et al.  Biodiversity on the Rocks: Macrofauna Inhabiting Authigenic Carbonate at Costa Rica Methane Seeps , 2015, PloS one.

[125]  Geraint Rees,et al.  Collective Enumeration , 2012, Journal of experimental psychology. Human perception and performance.

[126]  Erich Kirchler,et al.  The influence of member status differences and task type on group consensus and member position change , 1986 .

[127]  David V. Budescu,et al.  Improving Communication of Uncertainty in the Reports of the Intergovernmental Panel on Climate Change , 2009, Psychological science.

[128]  M. McPherson,et al.  Birds of a Feather: Homophily in Social Networks , 2001 .

[129]  John Thibaut,et al.  Seniority in the generational transition of laboratory groups: The effects of social familiarity and task experience☆ , 1982 .

[130]  Donelson R. Forsyth,et al.  Responsibility Diffusion in Cooperative Collectives , 2002 .

[131]  Eli Pariser,et al.  The Filter Bubble: What the Internet Is Hiding from You , 2011 .

[132]  P. Latham,et al.  References and Notes Supporting Online Material Materials and Methods Figs. S1 to S11 References Movie S1 Optimally Interacting Minds R�ports , 2022 .

[133]  Karl J. Friston,et al.  A systematic framework for functional connectivity measures , 2014, Front. Neurosci..

[134]  Glenn E. Littlepage,et al.  Recognition and utilization of expertise in problem-solving groups: Expert characteristics and behavior. , 1997 .

[135]  Colin Camerer,et al.  A framework for studying the neurobiology of value-based decision making , 2008, Nature Reviews Neuroscience.

[136]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[137]  J. O. Whittaker,et al.  A Repetition of Asch's “Effects of Group Pressure upon the Modification and Distortion of Judgment” , 1957 .

[138]  George Wright,et al.  The Delphi technique as a forecasting tool: issues and analysis , 1999 .

[139]  W. Keith Campbell,et al.  Narcissism, confidence, and risk attitude , 2004, Journal of Behavioral Decision Making.

[140]  Kunihide Sasou,et al.  Team errors: definition and taxonomy , 1999 .

[141]  Peter E. Latham,et al.  Does interaction matter? Testing whether a confidence heuristic can replace interaction in collective decision-making , 2014, Consciousness and Cognition.

[142]  Valerie L. Bartelt,et al.  Ethnic diversity deflates price bubbles , 2014, Proceedings of the National Academy of Sciences.

[143]  A. Kruglanski,et al.  Motivated closing of the mind: "seizing" and "freezing". , 1996, Psychological review.

[144]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[145]  K. Williams,et al.  Identifiability as a deterrant to social loafing: Two cheering experiments. , 1981 .

[146]  R S MacKay,et al.  Calibration with confidence: a principled method for panel assessment , 2015, Royal Society Open Science.

[147]  M. Bar-Hillel.  The base-rate fallacy in probability judgments. , 1980 .

[148]  Zeb Kurth-Nelson,et al.  Learning-Induced Plasticity in Medial Prefrontal Cortex Predicts Preference Malleability , 2015, Neuron.

[149]  V. Brescoll,et al.  Who Takes the Floor and Why , 2011 .

[150]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[151]  Naomi Oreskes,et al.  The Rejection of Continental Drift , 1988 .

[152]  J. Stuart Bunderson,et al.  Status cues and expertise assessment in groups , 2010 .

[153]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[154]  D. Helbing,et al.  Leadership, consensus decision making and collective behaviour in humans , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[155]  D. Myers,et al.  The group polarization phenomenon. , 1976 .

[156]  C. Frith,et al.  What failure in collective decision-making tells us about metacognition , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[157]  Ulf Toelch,et al.  Informational and Normative Influences in Conformity from a Neurocomputational Perspective , 2015, Trends in Cognitive Sciences.

[158]  M. Kocher,et al.  The Decision Maker Matters: Individual Versus Group Behaviour in Experimental Beauty-Contest Games , 2005 .

[159]  Kari Kristinsson,et al.  Does a different view create something new? The effect of employee diversity on innovation , 2011 .

[160]  P. Shekelle,et al.  Validity of the Agency for Healthcare Research and Quality clinical practice guidelines: how quickly do guidelines become outdated? , 2001, JAMA.

[161]  P. R. Laughlin,et al.  Demonstrability and social combination processes on mathematical intellective tasks. , 1986 .

[162]  G. Davies,et al.  Knowns and Unknowns , 2003 .

[163]  M. R. Leippe,et al.  Effects of integrative memorial and cognitive processes on the correspondence of eyewitness accuracy and confidence , 1980 .

[164]  Hiroshi Yama,et al.  Experts and laymen grossly underestimate the benefits of argumentation for reasoning , 2015 .

[165]  Robert H. Brook,et al.  How Coronary Angiography Is Used , 1987 .

[166]  M. Frank,et al.  Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. , 2009, Nature neuroscience.

[167]  Julia A. Minson,et al.  Two to Tango , 2011, Personality & social psychology bulletin.

[168]  T. Chartrand,et al.  The chameleon effect: the perception-behavior link and social interaction. , 1999, Journal of personality and social psychology.

[169]  Theodore T. Herbert,et al.  Improving Executive Decisions by Formalizing Dissent: The Corporate Devil's Advocate , 1977 .

[170]  Ralf H. J. M. Kurvers,et al.  Collective Intelligence Meets Medical Decision-Making: The Collective Outperforms the Best Radiologist , 2015, PloS one.

[171]  N. Kerr,et al.  Bias in judgment: Comparing individuals and groups. , 1996 .

[172]  Raymond J. Dolan,et al.  How People Use Social Information to Find out What to Want in the Paradigmatic Case of Inter-temporal Preferences , 2016, PLoS Comput. Biol..

[173]  N. Kerr,et al.  Group performance and decision making. , 2004, Annual review of psychology.

[174]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[175]  J. R. Larson,et al.  Discussion of shared and unshared information in decision-making groups , 1994 .

[176]  Pascal Huguet,et al.  Social loafing and self-beliefs: People's collective effort depends on the extent to which they distinguish themselves as better than others , 1998 .

[177]  S. Schulz-Hardt,et al.  Productive conflict in group decision making: genuine and contrived dissent as strategies to counteract biased information seeking☆ , 2002 .

[178]  M. Alicke,et al.  Conformity and Group Size , 1985 .

[179]  J. Dovidio,et al.  Implicit and explicit prejudice and interracial interaction. , 2002, Journal of personality and social psychology.

[180]  G. M. Wittenbaum,et al.  Mutual enhancement: Toward an understanding of the collective preference for shared information , 1999 .

[181]  Colin Camerer,et al.  In the Mind of the Market: Theory of Mind Biases Value Computation during Financial Bubbles , 2013, Neuron.

[182]  Ilan Yaniv,et al.  Group diversity and decision quality: Amplification and attenuation of the framing effect , 2011 .

[183]  Tobias Greitemeyer,et al.  Information sampling and group decision making: the effects of an advocacy decision procedure and task experience. , 2006, Journal of experimental psychology. Applied.

[184]  Katherine W. Phillips,et al.  Social Category Diversity Promotes Premeeting Elaboration: The Role of Relationship Focus , 2012, Organ. Sci..

[185]  R. Hertwig,et al.  The description–experience gap in risky choice , 2009, Trends in Cognitive Sciences.

[186]  J. Stuart Bunderson,et al.  Assessing member expertise in groups , 2014 .

[187]  Jonah Berger,et al.  Alone in a crowd of sheep: asymmetric perceptions of conformity and their roots in an introspection illusion. , 2007, Journal of personality and social psychology.

[188]  John R. Hollenbeck,et al.  Cooperation, competition and team performance: Toward a contingency approach , 2002 .

[189]  M. Graham,et al.  Science faculty’s subtle gender biases favor male students , 2012, Proceedings of the National Academy of Sciences.

[190]  E. Wilson,et al.  The Superorganism: The Beauty, Elegance, and Strangeness of Insect Societies , 2008 .

[191]  Charles A. Holt,et al.  Information Cascades in the Laboratory , 1998 .

[192]  H. Lau,et al.  How to measure metacognition , 2014, Front. Hum. Neurosci..

[193]  Andrew T. Hartnett,et al.  This PDF file includes: Materials and Methods SOM Text Figs. S1 to S12 Table S1 Full Reference List , 2022 .

[194]  A. Yuille,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Vision as Bayesian inference: analysis by synthesis? , 2022 .

[195]  P. Tetlock.  Expert Political Judgment: How Good Is It? How Can We Know? , 2005 .

[196]  J. Baron,et al.  The Power of Social Influence on Estimation Accuracy , 2015 .

[197]  J. Tenenbaum,et al.  Probabilistic models of cognition: exploring representations and inductive biases , 2010, Trends in Cognitive Sciences.

[198]  Thomas H. B. FitzGerald,et al.  Disruption of Dorsolateral Prefrontal Cortex Decreases Model-Based in Favor of Model-free Control in Humans , 2013, Neuron.

[199]  Robin L. Pinkley,et al.  Agreement Attraction and Impasse Aversion , 2016, Psychological science.

[200]  C. Heyes.  Who Knows? Metacognitive Social Learning Strategies , 2016, Trends in Cognitive Sciences.

[201]  Andrea B. Hollingshead,et al.  Potential Benefits of Communication in Transactive Memory Systems , 2003 .

[202]  Peter Fischer,et al.  Leadership and Information Processing , 2014 .

[203]  D. Wegner.  A Computer Network Model of Human Transactive Memory , 1995 .

[204]  F. Galton.  Vox Populi , 1907, Nature.

[205]  Michael Morreau,et al.  GRADING IN GROUPS , 2016, Economics and Philosophy.

[206]  Sue Curry Jansen,et al.  The Streisand Effect and Censorship Backfire , 2015 .

[207]  J. Stuart Bunderson,et al.  Recognizing and Utilizing Expertise in Work Groups: A Status Characteristics Perspective , 2003 .

[208]  Julija Mell,et al.  The catalyst effect: : The impact of transactive memory system structure on team performance , 2014 .

[209]  M. Shadlen,et al.  Decision Making and Sequential Sampling from Memory , 2016, Neuron.

[210]  Pieter R. Roelfsema,et al.  Variance misperception explains illusions of confidence in simple perceptual decisions , 2014, Consciousness and Cognition.

[211]  Walter Schaeken,et al.  Considering Too Few Alternatives: The Mental Model Theory of Extensional Reasoning , 2016, Quarterly journal of experimental psychology.