Control without controllers: Towards a distributed neuroscience of executive control

Executive control refers to the regulation of cognition and behavior by mental processes and is a hallmark of higher cognition. Most approaches to understanding its mechanisms begin with the assumption that our brains have anatomically segregated and functionally specialized control modules. The modular approach is intuitive: control is conceptually distinct from basic mental processing, so an organization that reifies that distinction makes sense. An alternative approach sees executive control as self-organizing principles of a distributed organization. In distributed systems, control and controlled processes are co-localized within large numbers of dispersed computational agents. Control then is often an emergent consequence of simple rules governing the interaction between agents. Because these systems are unfamiliar and unintuitive, here we review several well-understood examples of distributed control systems, group living insects and social animals, and emphasize their parallels with neural systems. We then re-examine the cognitive neuroscience literature on executive control for evidence that its neural control systems may be distributed.

[1]  David K Bilkey,et al.  Neurons in the Rat Anterior Cingulate Cortex Dynamically Encode Cost–Benefit in a Spatial Decision-Making Task , 2010, The Journal of Neuroscience.

[2]  Cameron S. Carter,et al.  The Neural and Computational Basis of Controlled Speed-Accuracy Tradeoff during Task Performance , 2008, Journal of Cognitive Neuroscience.

[3]  F. Delsuc Comparative Genomics , 2010, Lecture Notes in Computer Science.

[4]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[5]  David K Bilkey,et al.  Neural encoding of competitive effort in the anterior cingulate cortex , 2012, Nature Neuroscience.

[6]  Hidehiko Komatsu,et al.  Target Selection in Area V4 during a Multidimensional Visual Search Task , 2004, The Journal of Neuroscience.

[7]  Henry Kennedy,et al.  Brain structure and dynamics across scales: in search of rules , 2016, Current Opinion in Neurobiology.

[8]  T. Robbins,et al.  Inhibition and the right inferior frontal cortex: one decade on , 2014, Trends in Cognitive Sciences.

[9]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[10]  H. Niki,et al.  Prefrontal cortical unit activity and delayed alternation performance in monkeys. , 1971, Journal of neurophysiology.

[11]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[12]  J. Deneubourg,et al.  Memory and chemical communication in the orientation of two mass-recruiting ant species , 1993, Insectes Sociaux.

[13]  E A Codling,et al.  Group navigation and the "many-wrongs principle" in models of animal movement. , 2007, Ecology.

[14]  I. Couzin,et al.  Effective leadership and decision-making in animal groups on the move , 2005, Nature.

[15]  R. Logie Retiring the Central Executive , 2016, Quarterly journal of experimental psychology.

[16]  I. Couzin Collective cognition in animal groups , 2009, Trends in Cognitive Sciences.

[17]  E. Greenberg,et al.  Synergistic binding of the Vibrio fischeri LuxR transcriptional activator domain and RNA polymerase to the lux promoter region , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[18]  D. Hofstadter Gödel, Escher, Bach , 1979 .

[19]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[20]  T. Paus Primate anterior cingulate cortex: Where motor control, drive and cognition interface , 2001, Nature Reviews Neuroscience.

[21]  Eamonn B. Mallon,et al.  Individual and collective decision-making during nest site selection by the ant Leptothorax albipennis , 2001, Behavioral Ecology and Sociobiology.

[22]  P. Goldman-Rakic,et al.  Matching patterns of activity in primate prefrontal area 8a and parietal area 7ip neurons during a spatial working memory task. , 1998, Journal of neurophysiology.

[23]  T. Valone,et al.  Potential disadvantages of using socially acquired information. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[24]  B. Richmond,et al.  Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy , 2002, Science.

[25]  K. R. Ridderinkhof,et al.  Neurocognitive mechanisms of cognitive control: The role of prefrontal cortex in action selection, response inhibition, performance monitoring, and reward-based learning , 2004, Brain and Cognition.

[26]  Benjamin Y. Hayden,et al.  Posterior Cingulate Cortex Mediates Outcome-Contingent Allocation of Behavior , 2008, Neuron.

[27]  Ranulfo Romo,et al.  Flexible Control of Mutual Inhibition: A Neural Model of Two-Interval Discrimination , 2005, Science.

[28]  Andrew M Simons,et al.  Many wrongs: the advantage of group navigation. , 2004, Trends in ecology & evolution.

[29]  W. Foster,et al.  Group transmission of predator avoidance behaviour in a marine insect: The trafalgar effect , 1981, Animal Behaviour.

[30]  J. Deneubourg,et al.  Trails and U-turns in the Selection of a Path by the Ant Lasius niger , 1992 .

[31]  M. Walton,et al.  Separate neural pathways process different decision costs , 2006, Nature Neuroscience.

[32]  Agatha Lenartowicz,et al.  Towards an Ontology of Cognitive Control , 2010, Top. Cogn. Sci..

[33]  R. Marois,et al.  fMRI Evidence for a Dual Process Account of the Speed-Accuracy Tradeoff in Decision-Making , 2008, PloS one.

[34]  Colin Camerer,et al.  Transformation of stimulus value signals into motor commands during simple choice , 2011, Proceedings of the National Academy of Sciences.

[35]  Colin Camerer,et al.  Self-control in decision-making involves modulation of the vmPFC valuation system , 2009, NeuroImage.

[36]  Z. Bar-Joseph,et al.  Algorithms in nature: the convergence of systems biology and computational thinking , 2011, Molecular systems biology.

[37]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[38]  B. Bassler,et al.  Quorum sensing in bacteria. , 2001, Annual review of microbiology.

[39]  H. G. Wallraff Social interrelations involved in migratory orientation of birds: Possible contribution of field studies , 1978 .

[40]  J. Duncan An adaptive coding model of neural function in prefrontal cortex , 2001 .

[41]  Benjamin Y. Hayden,et al.  Human Neuroscience , 2022 .

[42]  Wolfgang M. Pauli,et al.  Computational models of cognitive control , 2010, Current Opinion in Neurobiology.

[43]  Lars Chittka,et al.  Dances as Windows into Insect Perception , 2004, PLoS biology.

[44]  F. Ratnieks Honeybee Democracy Thomas D. Seeley Honeybee Democracy , 2011, Animal Behaviour.

[45]  Paul J. B. Hart,et al.  Quorum decision-making facilitates information transfer in fish shoals , 2008, Proceedings of the National Academy of Sciences.

[46]  W. Kristan,et al.  Population coding and behavioral choice , 1997, Current Opinion in Neurobiology.

[47]  T. Shallice,et al.  Effects of focal frontal lesions on response inhibition. , 2006, Cerebral cortex.

[48]  A. Baddeley Exploring the Central Executive , 1996 .

[49]  B. Hayden,et al.  The Psychology and Neuroscience of Curiosity , 2015, Neuron.

[50]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[51]  C. Brooke Worth,et al.  The Insect Societies , 1973 .

[52]  J. Fodor,et al.  The Modularity of Mind: An Essay on Faculty Psychology , 1984 .

[53]  T. J. Roper,et al.  Group decision-making in animals , 2003, Nature.

[54]  L. Chelazzi,et al.  Neurons in Area V4 of the Macaque Translate Attended Visual Features into Behaviorally Relevant Categories , 2007, Neuron.

[55]  Gordon D Logan,et al.  Horse-race model simulations of the stop-signal procedure. , 2003, Acta psychologica.

[56]  Klaas E. Stephan,et al.  The anatomical basis of functional localization in the cortex , 2002, Nature Reviews Neuroscience.

[57]  N. Franks,et al.  A Mechanism for Value-Sensitive Decision-Making , 2013, PloS one.

[58]  Joshua W. Brown,et al.  Performance Monitoring by the Anterior Cingulate Cortex During Saccade Countermanding , 2003, Science.

[59]  M. Farah Neuropsychological inference with an interactive brain: A critique of the "locality" assumption. , 1994 .

[60]  Wolfgang Ziegler,et al.  Swarm Intelligence From Natural To Artificial Systems , 2016 .

[61]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[62]  S. Rauch,et al.  Obsessive-compulsive disorder: beyond segregated cortico-striatal pathways , 2012, Trends in Cognitive Sciences.

[63]  T. Robbins,et al.  Inhibition and the right inferior frontal cortex , 2004, Trends in Cognitive Sciences.

[64]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[65]  Michael L. Platt,et al.  Causal Evidence of Performance Monitoring by Neurons in Posterior Cingulate Cortex during Learning , 2013, Neuron.

[66]  Noga Alon,et al.  A Biological Solution to a Fundamental Distributed Computing Problem , 2011, Science.

[67]  John M. Pearson,et al.  Neuronal basis of sequential foraging decisions in a patchy environment , 2011, Nature Neuroscience.

[68]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[69]  Richard P. Cooper,et al.  Cognitive Control: Componential or Emergent? , 2010, Top. Cogn. Sci..

[70]  J. Ridley Studies of Interference in Serial Verbal Reactions , 2001 .

[71]  Deanna M. Barch,et al.  Extracting core components of cognitive control , 2006, Trends in Cognitive Sciences.

[72]  James F. A. Traniello,et al.  Key individuals and the organisation of labor in ants. , 1999 .

[73]  T. Vicsek,et al.  Self-organizing processes: The sound of many hands clapping , 2000, Nature.

[74]  Tommy C. Blanchard,et al.  Orbitofrontal Cortex Uses Distinct Codes for Different Choice Attributes in Decisions Motivated by Curiosity , 2015, Neuron.

[75]  K. Nealson,et al.  Bacterial bioluminescence: its control and ecological significance , 1979, Microbiological reviews.

[76]  D. Sumpter The principles of collective animal behaviour , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[77]  Robert C. Wilson,et al.  Orbitofrontal Cortex as a Cognitive Map of Task Space , 2014, Neuron.

[78]  Allison N. Norsworthy,et al.  Gimme shelter: how Vibrio fischeri successfully navigates an animal’s multiple environments , 2013, Front. Microbiol..

[79]  Geoffrey E. Hinton,et al.  The appeal of parallel distributed processing , 1986 .

[80]  G. Schwartz,et al.  Consciousness and Self-Regulation , 1976 .

[81]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[82]  J. Duncan,et al.  Intelligence and the Frontal Lobe: The Organization of Goal-Directed Behavior , 1996, Cognitive Psychology.

[83]  Rudolf Carnap,et al.  Meaning and Necessity , 1947 .

[84]  I. Couzin,et al.  Collective memory and spatial sorting in animal groups. , 2002, Journal of theoretical biology.

[85]  D. Plaut,et al.  Doing without schema hierarchies: a recurrent connectionist approach to normal and impaired routine sequential action. , 2004, Psychological review.

[86]  Joaquín M. Fuster,et al.  Cortex and Memory: Emergence of a New Paradigm , 2009, Journal of Cognitive Neuroscience.

[87]  D. Plaut,et al.  Distributed circuits, not circumscribed centers, mediate visual recognition , 2013, Trends in Cognitive Sciences.

[88]  B. Postle Working memory as an emergent property of the mind and brain , 2006, Neuroscience.

[89]  N. Volkow,et al.  The neural basis of addiction: a pathology of motivation and choice. , 2005, The American journal of psychiatry.

[90]  P. Dayan,et al.  Tonic dopamine: opportunity costs and the control of response vigor , 2007, Psychopharmacology.

[91]  Dirk Helbing,et al.  Modelling the evolution of human trail systems , 1997, Nature.

[92]  Jonathan D. Cohen,et al.  The Expected Value of Control: An Integrative Theory of Anterior Cingulate Cortex Function , 2013, Neuron.

[93]  Nils Kolling,et al.  A neural mechanism underlying failure of optimal choice with multiple alternatives , 2014, Nature Neuroscience.

[94]  John M. Pearson,et al.  Posterior cingulate cortex: adapting behavior to a changing world , 2011, Trends in Cognitive Sciences.

[95]  E. Murray,et al.  The role of the anterior cingulate cortex in choices based on reward value and reward contingency. , 2013, Cerebral cortex.

[96]  C. Gallistel The Organization of Action: A New Synthesis , 1982 .

[97]  D. Hofstadter Who shoves whom around inside the careenium? or what is the meaning of the word “I”? , 1982, Synthese.

[98]  M. Shadlen,et al.  Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque , 1999, Nature Neuroscience.

[99]  G. Reeke Marvin Minsky, The Society of Mind , 1991, Artif. Intell..

[100]  J. Tanji,et al.  Role for cingulate motor area cells in voluntary movement selection based on reward. , 1998, Science.

[101]  M. Roesch,et al.  A new perspective on the role of the orbitofrontal cortex in adaptive behaviour , 2009, Nature Reviews Neuroscience.

[102]  E. Fehr,et al.  Resisting the Power of Temptations , 2007, Annals of the New York Academy of Sciences.

[103]  Alex Kacelnik,et al.  Darwin’s “tug-of-war” vs. starlings’ “horse-racing”: how adaptations for sequential encounters drive simultaneous choice , 2010, Behavioral Ecology and Sociobiology.

[104]  Jeffrey D. Schall,et al.  Neural basis of deciding, choosing and acting , 2001, Nature Reviews Neuroscience.

[105]  John M. Pearson,et al.  Surprise Signals in Anterior Cingulate Cortex: Neuronal Encoding of Unsigned Reward Prediction Errors Driving Adjustment in Behavior , 2011, The Journal of Neuroscience.

[106]  M. Greicius,et al.  The Will to Persevere Induced by Electrical Stimulation of the Human Cingulate Gyrus , 2013, Neuron.

[107]  Shaun R. Patel,et al.  Human Dorsal Anterior Cingulate Cortex Neurons Mediate Ongoing Behavioral Adaptation , 2012, Nature.

[108]  D. Plaut Double dissociation without modularity: evidence from connectionist neuropsychology. , 1995, Journal of clinical and experimental neuropsychology.

[109]  Paul Miller,et al.  Inhibitory control by an integral feedback signal in prefrontal cortex: a model of discrimination between sequential stimuli. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[110]  R. Passingham Attention to action. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[111]  Lars Chittka,et al.  Speed-accuracy tradeoffs in animal decision making. , 2009, Trends in ecology & evolution.

[112]  J. Gallant,et al.  Attention to Stimulus Features Shifts Spectral Tuning of V4 Neurons during Natural Vision , 2008, Neuron.

[113]  Matthew M Botvinick,et al.  Short-term memory for serial order: a recurrent neural network model. , 2006, Psychological review.

[114]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[115]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[116]  O. Sporns,et al.  From regions to connections and networks: new bridges between brain and behavior , 2016, Current Opinion in Neurobiology.

[117]  Jeremy K. Seamans,et al.  Tracking Progress toward a Goal in Corticostriatal Ensembles , 2014, The Journal of Neuroscience.

[118]  R. Matthews,et al.  Ants. , 1898, Science.

[119]  I. Aoki A simulation study on the schooling mechanism in fish. , 1982 .

[120]  T. Seeley,et al.  Swarm cognition in honey bees , 2007, Behavioral Ecology and Sociobiology.

[121]  R. Leech,et al.  A functional network perspective on response inhibition and attentional control , 2014, Nature Communications.

[122]  R. Poldrack,et al.  Cortical and Subcortical Contributions to Stop Signal Response Inhibition: Role of the Subthalamic Nucleus , 2006, The Journal of Neuroscience.

[123]  Jack L. Gallant,et al.  Working Memory and Decision Processes in Visual Area V4 , 2013, Front. Neurosci..

[124]  Michael P Milham,et al.  Connectomics and new approaches for analyzing human brain functional connectivity , 2015, GigaScience.

[125]  Bradley R. Postle,et al.  Delay-period Activity in the Prefrontal Cortex: One Function Is Sensory Gating , 2005, Journal of Cognitive Neuroscience.

[126]  B. Iglewski,et al.  Active Efflux and Diffusion Are Involved in Transport of Pseudomonas aeruginosa Cell-to-Cell Signals , 1999, Journal of bacteriology.

[127]  R. Morecraft,et al.  Convergence of Limbic Input to the Cingulate Motor Cortex in the Rhesus Monkey , 1998, Brain Research Bulletin.

[128]  S. G. Reebs Can a minority of informed leaders determine the foraging movements of a fish shoal? , 2000, Animal Behaviour.

[129]  Walter Schneider,et al.  The cognitive control network: Integrated cortical regions with dissociable functions , 2007, NeuroImage.

[130]  Frederic M. Stoll,et al.  The Effects of Cognitive Control and Time on Frontal Beta Oscillations. , 2016, Cerebral cortex.

[131]  Eamonn B. Mallon,et al.  Information flow, opinion polling and collective intelligence in house-hunting social insects. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[132]  Christopher locke Fast, cheap and out of control , 1997, IEEE Internet Computing.

[133]  Timothy E. J. Behrens,et al.  Neural Mechanisms of Foraging , 2012, Science.

[134]  A. Turken,et al.  Response selection in the human anterior cingulate cortex , 1999, Nature Neuroscience.

[135]  Michael J. Frank,et al.  Understanding decision-making deficits in neurological conditions: insights from models of natural action selection , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[136]  Bradley R Postle,et al.  How Does the Brain Keep Information “in Mind”? , 2016, Current directions in psychological science.

[137]  Xin Jin,et al.  Start/stop signals emerge in nigrostriatal circuits during sequence learning , 2010, Nature.

[138]  R. B. Ebitz,et al.  Neuronal Activity in Primate Dorsal Anterior Cingulate Cortex Signals Task Conflict and Predicts Adjustments in Pupil-Linked Arousal , 2015, Neuron.

[139]  Jonathan D. Cohen,et al.  Prefrontal cortex and flexible cognitive control: rules without symbols. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[140]  James L. McClelland,et al.  Letting structure emerge: connectionist and dynamical systems approaches to cognition , 2010, Trends in Cognitive Sciences.

[141]  Joshua W. Brown,et al.  Monitoring and Control of Action by the Frontal Lobes , 2002, Neuron.

[142]  Olaf Sporns,et al.  The Human Connectome: A Structural Description of the Human Brain , 2005, PLoS Comput. Biol..

[143]  D. Grünbaum Schooling as a strategy for taxis in a noisy environment , 1998, Evolutionary Ecology.

[144]  E. Greenberg,et al.  Diffusion of autoinducer is involved in regulation of the Vibrio fischeri luminescence system , 1985, Journal of bacteriology.

[145]  D. Sumpter,et al.  Phase transition between disordered and ordered foraging in Pharaoh's ants , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[146]  J. Kalaska,et al.  Neural mechanisms for interacting with a world full of action choices. , 2010, Annual review of neuroscience.

[147]  Jonathan D. Cohen,et al.  Conflict monitoring and anterior cingulate cortex: an update , 2004, Trends in Cognitive Sciences.

[148]  Andrew J Sharp,et al.  Back to the past in schizophrenia genomics , 2015, Nature Neuroscience.

[149]  M Schwartz,et al.  The effects of focal and diffuse brain damage on strategy application: Evidence from focal lesions, traumatic brain injury and normal aging , 1998, Journal of the International Neuropsychological Society.

[150]  Brianna J. Sleezer,et al.  Signatures of Value Comparison in Ventral Striatum Neurons , 2015, PLoS biology.

[151]  Philip G. F. Browning,et al.  Dissociable Components of Rule-Guided Behavior Depend on Distinct Medial and Prefrontal Regions , 2009, Science.

[152]  Cameron S. Carter,et al.  Overactive Action Monitoring in Obsessive-Compulsive Disorder , 2003, Psychological science.

[153]  A. Dornhaus,et al.  Psychophysics: Bees trade off foraging speed for accuracy , 2003, Nature.

[154]  Yoshikazu Isomura,et al.  Neural Coding of “Attention for Action” and “Response Selection” in Primate Anterior Cingulate Cortex , 2003, The Journal of Neuroscience.

[155]  Eamonn B. Mallon,et al.  Quorum sensing, recruitment, and collective decision-making during colony emigration by the ant Leptothorax albipennis , 2002, Behavioral Ecology and Sociobiology.

[156]  T. Pasternak,et al.  Working memory in primate sensory systems , 2005, Nature Reviews Neuroscience.

[157]  R. Desimone,et al.  Responses of Neurons in Inferior Temporal Cortex during Memory- Guided Visual Search , 1998 .

[158]  T. Shallice Specific impairments of planning. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[159]  Edward G. Ruby,et al.  Vibrio fischeri lux Genes Play an Important Role in Colonization and Development of the Host Light Organ , 2000, Journal of bacteriology.

[160]  Guy Theraulaz,et al.  The origin of nest complexity in social insects , 1998, Complex..

[161]  Wayne A. Wickelgren,et al.  Speed-accuracy tradeoff and information processing dynamics , 1977 .

[162]  I. Couzin,et al.  Shared decision-making drives collective movement in wild baboons , 2015, Science.

[163]  T. Moore,et al.  Neural Mechanisms of Selective Visual Attention. , 2017, Annual review of psychology.

[164]  I. Couzin,et al.  Self-Organization and Collective Behavior in Vertebrates , 2003 .

[165]  P. Cisek Making decisions through a distributed consensus , 2012, Current Opinion in Neurobiology.

[166]  T. Robbins,et al.  Stop-signal inhibition disrupted by damage to right inferior frontal gyrus in humans , 2003, Nature Neuroscience.

[167]  Jonathan D. Cohen,et al.  The Computational and Neural Basis of Cognitive Control: Charted Territory and New Frontiers , 2014, Cogn. Sci..

[168]  R. Romo,et al.  Decoding a Perceptual Decision Process across Cortex , 2010, Neuron.

[169]  Barbara Webb,et al.  Swarm Intelligence: From Natural to Artificial Systems , 2002, Connect. Sci..

[170]  Richard F. Betzel,et al.  Modular Brain Networks. , 2016, Annual review of psychology.

[171]  Benjamin Y. Hayden,et al.  Differential Contributions of Ventral and Dorsal Striatum to Early and Late Phases of Cognitive Set Reconfiguration , 2016, Journal of Cognitive Neuroscience.

[172]  B. Hayden,et al.  Dorsal anterior cingulate: a Rorschach test for cognitive neuroscience , 2016, Nature Neuroscience.

[173]  I. Couzin,et al.  Consensus decision making in human crowds , 2008, Animal Behaviour.

[174]  Anna Dornhaus,et al.  Speed versus accuracy in collective decision making , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[175]  Suzanne N. Haber,et al.  Circuit-Based Corticostriatal Homologies Between Rat and Primate , 2016, Biological Psychiatry.

[176]  Guy Theraulaz,et al.  A Brief History of Stigmergy , 1999, Artificial Life.

[177]  Seth A. Herd,et al.  A Unified Framework for Inhibitory Control Opinion , 2022 .

[178]  C. Padoa-Schioppa,et al.  Neuronal Encoding of Subjective Value in Dorsal and Ventral Anterior Cingulate Cortex , 2012, The Journal of Neuroscience.

[179]  E. Procyk,et al.  Anterior cingulate activity during routine and non-routine sequential behaviors in macaques , 2000, Nature Neuroscience.

[180]  K. Lashley The problem of serial order in behavior , 1951 .

[181]  Jonathan D. Cohen,et al.  Conflict monitoring versus selection-for-action in anterior cingulate cortex , 1999, Nature.

[182]  Suzanne N Haber,et al.  Frontal Cortical and Subcortical Projections Provide a Basis for Segmenting the Cingulum Bundle: Implications for Neuroimaging and Psychiatric Disorders , 2014, The Journal of Neuroscience.

[183]  M. Lindauer Communication Among the Honeybees and Stingless Bees of India , 1957 .

[184]  Tommy C. Blanchard,et al.  Reward Value Comparison via Mutual Inhibition in Ventromedial Prefrontal Cortex , 2014, Neuron.

[185]  Paul Miller,et al.  Heterogenous Population Coding of a Short-Term Memory and Decision Task , 2010, The Journal of Neuroscience.

[186]  Jerald D. Kralik,et al.  Representation of Attended Versus Remembered Locations in Prefrontal Cortex , 2004, PLoS biology.

[187]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[188]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[189]  Benjamin Y Hayden,et al.  Dorsal Anterior Cingulate Cortex: A Bottom-Up View. , 2016, Annual review of neuroscience.

[190]  Donald A. Norman,et al.  Attention to Action , 1986 .

[191]  John M. Pearson,et al.  Fictive Reward Signals in the Anterior Cingulate Cortex , 2009, Science.

[192]  Yong He,et al.  Understanding Structural-Functional Relationships in the Human Brain , 2015, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[193]  P. Visscher,et al.  House-hunting by honey bee swarms: collective decisions and individual behaviors , 1999, Insectes Sociaux.

[194]  S. C. Winans,et al.  Autoinducer binding by the quorum-sensing regulator TraR increases affinity for target promoters in vitro and decreases TraR turnover rates in whole cells. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[195]  Mark G. Baxter,et al.  Functional localization within the prefrontal cortex: missing the forest for the trees? , 2010, Trends in Neurosciences.

[196]  E. Bullmore,et al.  Mapping Motor Inhibition: Conjunctive Brain Activations across Different Versions of Go/No-Go and Stop Tasks , 2001, NeuroImage.

[197]  Timothy E. J. Behrens,et al.  Optimal decision making and the anterior cingulate cortex , 2006, Nature Neuroscience.

[198]  Ilya R. Fischhoff,et al.  Social relationships and reproductive state influence leadership roles in movements of plains zebra, Equus burchellii , 2007, Animal Behaviour.

[199]  Mark A. Straccia,et al.  Dorsal anterior cingulate and ventromedial prefrontal cortex have inverse roles in both foraging and economic choice , 2016, Cognitive, Affective, & Behavioral Neuroscience.

[200]  Habiba Azab,et al.  Shared roles of dorsal and subgenual anterior cingulate cortices in economic decisions , 2016, bioRxiv.

[201]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[202]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[203]  Mel W. Khaw,et al.  Normalization is a general neural mechanism for context-dependent decision making , 2013, Proceedings of the National Academy of Sciences.

[204]  Habiba Azab,et al.  Neuronal selectivity for spatial positions of offers and choices in five reward regions. , 2016, Journal of neurophysiology.

[205]  M. Botvinick,et al.  Conflict monitoring and cognitive control. , 2001, Psychological review.

[206]  B. Hayden,et al.  Neurons in Anterior Cingulate Cortex Multiplex Information about Reward and Action , 2010, The Journal of Neuroscience.

[207]  M. McFall-Ngai Divining the Essence of Symbiosis: Insights from the Squid-Vibrio Model , 2014, PLoS biology.

[208]  Marvin Minsky,et al.  Society of Mind: A Response to Four Reviews , 1991, Artif. Intell..

[209]  H. Seo,et al.  Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game , 2007, The Journal of Neuroscience.

[210]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[211]  M. Roesch,et al.  Neuronal activity in macaque SEF and ACC during performance of tasks involving conflict. , 2005, Journal of neurophysiology.

[212]  M. Posner,et al.  Cognitive and emotional influences in anterior cingulate cortex , 2000, Trends in Cognitive Sciences.

[213]  G. Bergman,et al.  An analysis of the spring migration of the common scoter and the long-tailed duck in southern Finland , 1964 .

[214]  V. Smith,et al.  Stock Market Bubbles in the Laboratory , 1994 .

[215]  Marco K. Wittmann,et al.  Multiple signals in anterior cingulate cortex , 2016, Current Opinion in Neurobiology.

[216]  Keiji Tanaka,et al.  Medial prefrontal cell activity signaling prediction errors of action values , 2007, Nature Neuroscience.

[217]  D. Sharp,et al.  Contrasting network and modular perspectives on inhibitory control , 2015, Trends in Cognitive Sciences.

[218]  Benjamin Y Hayden,et al.  All that glitters is not reward signal , 2014, Nature Neuroscience.

[219]  J. Jonides,et al.  Overlapping mechanisms of attention and spatial working memory , 2001, Trends in Cognitive Sciences.

[220]  B. Bassler,et al.  Quorum sensing: cell-to-cell communication in bacteria. , 2005, Annual review of cell and developmental biology.

[221]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[222]  Steven W Kennerley,et al.  Single-Neuron Mechanisms Underlying Cost-Benefit Analysis in Frontal Cortex , 2013, The Journal of Neuroscience.

[223]  S. Floresco The nucleus accumbens: an interface between cognition, emotion, and action. , 2015, Annual review of psychology.

[224]  Jonathan D. Wallis,et al.  Neurons in the Frontal Lobe Encode the Value of Multiple Decision Variables , 2009, Journal of Cognitive Neuroscience.

[225]  A. Bechara Decision making, impulse control and loss of willpower to resist drugs: a neurocognitive perspective , 2005, Nature Neuroscience.

[226]  Melanie Mitchell,et al.  Complexity - A Guided Tour , 2009 .

[227]  K. R. Ridderinkhof,et al.  Striatum and pre-SMA facilitate decision-making under time pressure , 2008, Proceedings of the National Academy of Sciences.

[228]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[229]  E. Miller,et al.  The prefontral cortex and cognitive control , 2000, Nature Reviews Neuroscience.

[230]  Stephen Grossberg,et al.  Classical and Instrumental Learning by Neural Networks , 1982 .

[231]  Sarah R. Heilbronner,et al.  Decision Salience Signals in Posterior Cingulate Cortex , 2011, Front. Neurosci..

[232]  Tommy C. Blanchard,et al.  Ramping ensemble activity in dorsal anterior cingulate neurons during persistent commitment to a decision. , 2015, Journal of neurophysiology.

[233]  Keiji Tanaka,et al.  Mnemonic Function of the Dorsolateral Prefrontal Cortex in Conflict-Induced Behavioral Adjustment , 2007, Science.

[234]  S. Bressler,et al.  Large-scale brain networks in cognition: emerging methods and principles , 2010, Trends in Cognitive Sciences.

[235]  Brianna J. Sleezer,et al.  Rule Encoding in Orbitofrontal Cortex and Striatum Guides Selection , 2016, The Journal of Neuroscience.

[236]  J S Fowler,et al.  Addiction, a disease of compulsion and drive: involvement of the orbitofrontal cortex. , 2000, Cerebral cortex.

[237]  V. Smith,et al.  Bubbles, Crashes, and Endogenous Expectations in Experimental Spot Asset Markets , 1988 .

[238]  G. Logan,et al.  Inhibitory control in mind and brain: an interactive race model of countermanding saccades. , 2007, Psychological review.

[239]  Duncan E. Jackson,et al.  Modulation of pheromone trail strength with food quality in Pharaoh's ant, Monomorium pharaonis , 2007, Animal Behaviour.

[240]  J. Wallis,et al.  Dynamic Encoding of Responses and Outcomes by Neurons in Medial Prefrontal Cortex , 2009, The Journal of Neuroscience.

[241]  D. Sumpter,et al.  From Compromise to Leadership in Pigeon Homing , 2006, Current Biology.

[242]  A. Dussutour,et al.  Amoeboid organism solves complex nutritional challenges , 2010, Proceedings of the National Academy of Sciences.

[243]  G. Pezzulo,et al.  Navigating the Affordance Landscape: Feedback Control as a Process Model of Behavior and Cognition , 2016, Trends in Cognitive Sciences.

[244]  B T Thomas Yeo,et al.  The modular and integrative functional architecture of the human brain , 2015, Proceedings of the National Academy of Sciences.

[245]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[246]  T. Seeley,et al.  Group decision making in swarms of honey bees , 1999, Behavioral Ecology and Sociobiology.

[247]  Timothy E. J. Behrens,et al.  Review Frontal Cortex and Reward-guided Learning and Decision-making Figure 1. Frontal Brain Regions in the Macaque Involved in Reward-guided Learning and Decision-making Finer Grained Anatomical Divisions with Frontal Cortical Systems for Reward-guided Behavior , 2022 .

[248]  R. Bogacz,et al.  The neural basis of the speed–accuracy tradeoff , 2010, Trends in Neurosciences.

[249]  M. R. Riley,et al.  Role of Prefrontal Persistent Activity in Working Memory , 2016, Front. Syst. Neurosci..