The evolution and devolution of cognitive control: The costs of deliberation in a competitive world

Dual-system theories of human cognition, under which fast automatic processes can complement or compete with slower deliberative processes, have not typically been incorporated into larger scale population models used in evolutionary biology, macroeconomics, or sociology. However, doing so may reveal important phenomena at the population level. Here, we introduce a novel model of the evolution of dual-system agents using a resource-consumption paradigm. By simulating agents with the capacity for both automatic and controlled processing, we illustrate how controlled processing may not always be selected over rigid, but rapid, automatic processing. Furthermore, even when controlled processing is advantageous, frequency-dependent effects may exist whereby the spread of control within the population undermines this advantage. As a result, the level of controlled processing in the population can oscillate persistently, or even go extinct in the long run. Our model illustrates how dual-system psychology can be incorporated into population-level evolutionary models, and how such a framework can be used to examine the dynamics of interaction between automatic and controlled processing that transpire over an evolutionary time scale.

[1]  Jorge M. Pacheco,et al.  Evolution of collective action in adaptive social structures , 2013, Scientific Reports.

[2]  Nick Chater,et al.  Evolution in a Changing Environment , 2013, PloS one.

[3]  David G. Rand,et al.  Spontaneous giving and calculated greed , 2012, Nature.

[4]  J. Duncan,et al.  Common regions of the human frontal lobe recruited by diverse cognitive demands , 2000, Trends in Neurosciences.

[5]  Jonathan Evans In two minds: dual-process accounts of reasoning , 2003, Trends in Cognitive Sciences.

[6]  D. Fudenberg,et al.  A Dual Self Model of Impulse Control , 2004, The American economic review.

[7]  R. H. Strotz Myopia and Inconsistency in Dynamic Utility Maximization , 1955 .

[8]  C. Plott,et al.  Economic Theory of Choice and the Preference Reversal Phenomenon , 1979 .

[9]  S. Gould,et al.  The spandrels of San Marco and the Panglossian paradigm: a critique of the adaptationist programme , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[10]  Samuel M. McClure,et al.  Towards a general model of temporal discounting. , 2013, Journal of the experimental analysis of behavior.

[11]  G. Loewenstein Out of control: Visceral influences on behavior , 1996 .

[12]  L. Cosmides,et al.  Beyond intuition and instinct blindness: toward an evolutionarily rigorous cognitive science , 1994, Cognition.

[13]  Walter Schneider,et al.  Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention. , 1977 .

[14]  H. Uylings,et al.  Qualitative and quantitative comparison of the prefrontal cortex in rat and in primates, including humans. , 1990, Progress in brain research.

[15]  A. Ward,et al.  Don't mind if I do: disinhibited eating under cognitive load. , 2000, Journal of personality and social psychology.

[16]  James L. McClelland,et al.  Automaticity , Attention and the Strength of Processing : A Parallel Distributed Processing Account of the Stroop Effect , 2001 .

[17]  P. Mahadevan,et al.  An overview , 2007, Journal of Biosciences.

[18]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[19]  H. Barrett,et al.  Modularity in cognition: framing the debate. , 2006, Psychological review.

[20]  Jonathan Evans Dual-processing accounts of reasoning, judgment, and social cognition. , 2008, Annual review of psychology.

[21]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[22]  Alan S. Brown,et al.  Information Processing and Cognition: The Loyola Symposium , 1976 .

[23]  R. Thaler,et al.  An Economic Theory of Self-Control , 1977, Journal of Political Economy.

[24]  Peter Dayan,et al.  Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees , 2012, PLoS Comput. Biol..

[25]  W. Ewens Mathematical Population Genetics : I. Theoretical Introduction , 2004 .

[26]  Michael Tomasello,et al.  Human Culture in Evolutionary Perspective , 2010 .

[27]  A. U.S.,et al.  Predictability , Complexity , and Learning , 2002 .

[28]  Jonathan Evans,et al.  Science Perspectives on Psychological , 2022 .

[29]  M. Posner,et al.  The attention system of the human brain. , 1990, Annual review of neuroscience.

[30]  T Shallice,et al.  The domain of supervisory processes and temporal organization of behaviour. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[31]  Yishay Mansour,et al.  A Sparse Sampling Algorithm for Near-Optimal Planning in Large Markov Decision Processes , 1999, Machine Learning.

[32]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[33]  F. C. Santos,et al.  Risk of collective failure provides an escape from the tragedy of the commons , 2011, Proceedings of the National Academy of Sciences.

[34]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[35]  J. Metcalfe,et al.  A hot/cool-system analysis of delay of gratification: dynamics of willpower. , 1999, Psychological review.

[36]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[37]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[38]  A. Glenberg,et al.  Framing the Debate , 2022 .

[39]  K. Stanovich,et al.  Heuristics and Biases: Individual Differences in Reasoning: Implications for the Rationality Debate? , 2002 .

[40]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[41]  Faruk Gul,et al.  Temptation and Self‐Control , 1999 .

[42]  A. Tversky,et al.  The Causes of Preference Reversal , 1990 .

[43]  Richard S. Sutton,et al.  Integrated Architectures for Learning, Planning, and Reacting Based on Approximating Dynamic Programming , 1990, ML.

[44]  A. Baddeley,et al.  Executive functions and self-regulation , 2012, Trends in Cognitive Sciences.

[45]  R. Baumeister,et al.  Self-Regulation Failure: An Overview , 1996 .

[46]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[47]  Dominic D. P. Johnson,et al.  The evolution of overconfidence , 2009, Nature.

[48]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[49]  D. Kahneman Maps of Bounded Rationality: Psychology for Behavioral Economics , 2003 .

[50]  A. Tversky,et al.  Extensional versus intuitive reasoning: the conjunction fallacy in probability judgment , 1983 .

[51]  David I. Laibson,et al.  Golden Eggs and Hyperbolic Discounting , 1997 .

[52]  P. Whitney,et al.  Impulsive decision making and working memory. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[53]  Eric J. Johnson,et al.  Lateral prefrontal cortex and self-control in intertemporal choice , 2010, Nature Neuroscience.

[54]  Ted O’Donoghue,et al.  Doing It Now or Later , 1999 .

[55]  D. Brooks,et al.  Evidence for striatal dopamine release during a video game , 1998, Nature.

[56]  T. Preuss Do Rats Have Prefrontal Cortex? The Rose-Woolsey-Akert Program Reconsidered , 1995, Journal of Cognitive Neuroscience.

[57]  Colin Camerer,et al.  Self-control in decision-making involves modulation of the vmPFC valuation system , 2009, NeuroImage.

[58]  Xu Fuming,et al.  Conjunction Fallacy in Probability Judgment , 2015 .

[59]  R. Thaler Some empirical evidence on dynamic inconsistency , 1981 .

[60]  Jonathan D. Cohen,et al.  Journal of Economic Perspectives—Volume 19, Number 4—Fall 2005—Pages 3–24 The Vulcanization of the Human Brain: A Neural Perspective on Interactions Between Cognition and Emotion , 2022 .

[61]  G. Ainslie Specious reward: a behavioral theory of impulsiveness and impulse control. , 1975, Psychological bulletin.

[62]  W. Mischel,et al.  Delay of gratification in children. , 1989, Science.

[63]  R. Thaler,et al.  An Economic Theory of Self-Control , 1977, Journal of Political Economy.

[64]  James L. McClelland,et al.  On the control of automatic processes: a parallel distributed processing account of the Stroop effect. , 1990, Psychological review.