The Dark Side of Information Proliferation

There are well-understood psychological limits on our capacity to process information. As information proliferation—the consumption and sharing of information—increases through social media and other communications technology, these limits create an attentional bottleneck, favoring information that is more likely to be searched for, attended to, comprehended, encoded, and later reproduced. In information-rich environments, this bottleneck influences the evolution of information via four forces of cognitive selection, selecting for information that is belief-consistent, negative, social, and predictive. Selection for belief-consistent information leads balanced information to support increasingly polarized views. Selection for negative information amplifies information about downside risks and crowds out potential benefits. Selection for social information drives herding, impairs objective assessments, and reduces exploration for solutions to hard problems. Selection for predictive patterns drives overfitting, the replication crisis, and risk seeking. This article summarizes the negative implications of these forces of cognitive selection and presents eight warnings that represent severe pitfalls for the naive “informavore,” accelerating extremism, hysteria, herding, and the proliferation of misinformation.

[1]  J. Barlow The Shallows: What the Internet is Doing to Our Brains , 2010 .

[2]  David Lazer,et al.  The Network Structure of Exploration and Exploitation , 2007 .

[3]  Thomas T. Hills,et al.  Bad News Has Wings: Dread Risk Mediates Social Amplification in Risk Communication , 2018, Risk analysis : an official publication of the Society for Risk Analysis.

[4]  M. Augier,et al.  Administrative Behavior: A Study of Decision‐Making Processes in Administrative Organizations , 2002 .

[5]  Janet Chan,et al.  Is Big Data challenging criminology? , 2016, SSRN Electronic Journal.

[6]  Thomas T. Hills,et al.  Experience-Based Decisions Favor Riskier Alternatives in Large Sets , 2016 .

[7]  Angela Fagerlin,et al.  Biased Assimilation of Sociopolitical Arguments: Evaluating the 1996 U.S. Presidential Debate , 2002 .

[8]  Xiaoli Nan,et al.  Biased Assimilation and Need for Closure: Examining the Effects of Mixed Blogs on Vaccine-Related Beliefs , 2015, Journal of health communication.

[9]  A Arak,et al.  Conflict, receiver bias and the evolution of signal form. , 1995, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[10]  Tobias Greitemeyer I Am Right, You Are Wrong: How Biased Assimilation Increases the Perceived Gap between Believers and Skeptics of Violent Video Game Effects , 2014, PloS one.

[11]  Michael F. Bunting,et al.  The cocktail party phenomenon revisited: The importance of working memory capacity , 2001, Psychonomic bulletin & review.

[12]  R. Trivers,et al.  Deceit and self-deception : fooling yourself the better to fool others , 2013 .

[13]  Ortwin Renn,et al.  The Social Amplification of Risk: A Conceptual Framework , 1988 .

[14]  Sinan Aral,et al.  The spread of true and false news online , 2018, Science.

[15]  Jerker Denrell,et al.  Should We Be Impressed With High Performance? , 2005 .

[16]  Ido Erev,et al.  Replicated alternatives and the role of confusion, chasing, and regret in decisions from experience , 2007 .

[17]  Jerker Denrell,et al.  Top performers are not the most impressive when extreme performance indicates unreliability , 2012, Proceedings of the National Academy of Sciences.

[18]  Lada A. Adamic,et al.  Exposure to ideologically diverse news and opinion on Facebook , 2015, Science.

[19]  Ullrich K. H. Ecker,et al.  Beyond Misinformation: Understanding and coping with the post-truth era , 2017 .

[20]  Miriam J. Metzger,et al.  The science of fake news , 2018, Science.

[21]  David A. Luther,et al.  The influence of the acoustic community on songs of birds in a neotropical rain forest , 2009 .

[22]  Solomon E. Asch,et al.  Opinions and Social Pressure , 1955 .

[23]  Nick Chater,et al.  Herding in humans , 2009, Trends in Cognitive Sciences.

[24]  Daniel Gayo-Avello,et al.  No, You Cannot Predict Elections with Twitter , 2012, IEEE Internet Comput..

[25]  Mirta Galesic,et al.  Social learning strategies modify the effect of network structure on group performance , 2016, Nature Communications.

[26]  Nick Chater,et al.  The Under-Appreciated Drive for Sense-Making , 2015 .

[27]  Measuring the Information Society Report , 2015 .

[28]  Matthew J. Salganik,et al.  Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market , 2006, Science.

[29]  A. Corner,et al.  Uncertainty, scepticism and attitudes towards climate change: biased assimilation and attitude polarisation , 2012, Climatic Change.

[30]  Stephan Hamann,et al.  Neural Bases of Motivated Reasoning: An fMRI Study of Emotional Constraints on Partisan Political Judgment in the 2004 U.S. Presidential Election , 2006, Journal of Cognitive Neuroscience.

[31]  Simon Kirby,et al.  Cumulative cultural evolution in the laboratory: An experimental approach to the origins of structure in human language , 2008, Proceedings of the National Academy of Sciences.

[32]  M. Frank,et al.  Computational psychiatry as a bridge from neuroscience to clinical applications , 2016, Nature Neuroscience.

[33]  Robert L. Goldstone,et al.  Collective Behavior , 2002 .

[34]  L. Ross,et al.  Biased Assimilation and Attitude Polarization: The Effects of Prior Theories on Subsequently Considered Evidence , 1979 .

[35]  S. Veissière,et al.  Hypernatural Monitoring: A Social Rehearsal Account of Smartphone Addiction , 2018, Front. Psychol..

[36]  Reid Hastie,et al.  Effects of Amount of Information on Judgment Accuracy and Confidence , 2008 .

[37]  Leif D. Nelson,et al.  False-Positive Psychology , 2011, Psychological science.

[38]  A. Tversky,et al.  Loss Aversion in Riskless Choice: A Reference-Dependent Model , 1991 .

[39]  Wolfgang Gaissmaier,et al.  The amplification of risk in experimental diffusion chains , 2015, Proceedings of the National Academy of Sciences.

[40]  D. Lazer,et al.  The Parable of Google Flu: Traps in Big Data Analysis , 2014, Science.

[41]  G. Berns,et al.  Expert Financial Advice Neurobiologically “Offloads” Financial Decision-Making under Risk , 2009, PloS one.

[42]  Thomas T. Hills,et al.  Recent evolution of learnability in American English from 1800 to 2000 , 2015, Cognition.

[43]  R. Lanfear,et al.  A generation time effect on the rate of molecular evolution in invertebrates. , 2010, Molecular biology and evolution.

[44]  J. Jacoby,et al.  Brand Choice Behavior as a Function of Information Load , 1974 .

[45]  J. Dessalles,et al.  Arguing, reasoning, and the interpersonal (cultural) functions of human consciousness , 2011, Behavioral and Brain Sciences.

[46]  R. Hastie,et al.  WHEN DELIBERATION PRODUCES EXTREMISM , 2010 .

[47]  M. Shermer Conspiracy central. Who believes in conspiracy theories--and why. , 2014, Scientific American.

[48]  Antal van den Bosch,et al.  Estimating search engine index size variability: a 9-year longitudinal study , 2016, Scientometrics.

[49]  David Bawden,et al.  The dark side of information: overload, anxiety and other paradoxes and pathologies , 2009, J. Inf. Sci..

[50]  M. Korstanje The Risk Society: Towards a new modernity , 2009 .

[51]  Martin Hilbert,et al.  The World’s Technological Capacity to Store, Communicate, and Compute Information , 2011, Science.

[52]  P. Fischer,et al.  Selective exposure and information quantity: how different information quantities moderate decision makers' preference for consistent and inconsistent information. , 2008, Journal of personality and social psychology.

[53]  A. Bandura Vicarious Processes: A Case of No-Trial Learning1 , 1965 .

[54]  C. Sunstein The Law of Group Polarization , 1999, How Change Happens.

[55]  Stephan Hamann,et al.  Cognitive and neural mechanisms of emotional memory , 2001, Trends in Cognitive Sciences.

[56]  Richard A. Lanham,et al.  The `Economics of Attention: Style and Substance in the Age of Information , 2006 .

[57]  Thomas M. Chen,et al.  Introduction to the Special Issue: Terrorist Online Propaganda and Radicalization , 2017 .

[58]  Jen-Hung Huang,et al.  Herding in online product choice , 2006 .

[59]  Robert L. Goldstone,et al.  Propagation of innovations in networked groups. , 2008, Journal of experimental psychology. General.

[60]  Christina Fang,et al.  Balancing Exploration and Exploitation through Structural Design: The Isolation of Subgroups and Organization Learning , 2008 .

[61]  S. Blackmore The Meme Machine , 1999 .

[62]  P. Slovic Perception of risk. , 1987, Science.

[63]  James J. Kellaris,et al.  The Role of Selective Information Processing in Price-Quality Inference , 2004 .

[64]  Dan Ariely,et al.  When Rational Sellers Face Nonrational Buyers: Evidence from Herding on eBay , 2008, Manag. Sci..

[65]  Adam Wierman,et al.  Thinking Fast and Slow , 2017, SIGMETRICS Perform. Evaluation Rev..

[66]  D. Helbing,et al.  How social influence can undermine the wisdom of crowd effect , 2011, Proceedings of the National Academy of Sciences.

[67]  Daisuke Nakanishi,et al.  Does social/cultural learning increase human adaptability?: Rogers's question revisited , 2003 .

[68]  Jill A. Warker,et al.  Major memory for microblogs , 2013, Memory & cognition.

[69]  Filippo Menczer,et al.  Measuring Online Social Bubbles , 2015, 1502.07162.

[70]  John P. A. Ioannidis,et al.  A manifesto for reproducible science , 2017, Nature Human Behaviour.

[71]  R. Bénabou Groupthink: Collective Delusions in Organizations and Markets , 2009, SSRN Electronic Journal.

[72]  B. Schwartz The tyranny of choice. , 2004, Scientific American.

[73]  Michael Bryce,et al.  Test 5.14.4. Deposit 18 June 15:43, embargoed 18/07/2019 : Article -> Review article , 2019 .

[74]  Joshua A. Tucker,et al.  Is Online Political Communication More Than an Echo Chamber? , 2022 .

[75]  Yu Jie Ng,et al.  To fear or not to fear? Applying the social amplification of risk framework on two environmental health risks in Singapore , 2018 .

[76]  Peter H. Ditto,et al.  Biased Assimilation, Attitude Polarization, and Affect in Reactions to Stereotype-Relevant Scientific Information , 1997 .

[77]  M. Meeter,et al.  Short- and long-lasting consequences of novelty, deviance and surprise on brain and cognition , 2015, Neuroscience & Biobehavioral Reviews.

[78]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[79]  John P A Ioannidis,et al.  Is everything we eat associated with cancer? A systematic cookbook review. , 2013, The American journal of clinical nutrition.

[80]  Martin J. Eppler Information quality and information overload: The promises and perils of the information age , 2015 .

[81]  Loyal Jones,et al.  Remembering , 1975, IEEE Power Engineering Review.

[82]  Thomas T. Hills,et al.  Attention Economies, Information Crowding, and Language Change , 2017 .