From a single decision to a multi-step algorithm

Humans can perform sequential and recursive computations, as when calculating 23×74. However, this comes at a cost: flexible computations are slow and effortful. We argue that this competence involves serial chains of successive decisions, each based on the accumulation of evidence up to a threshold and forwarding the result to the subsequent step. Such serial 'programs' require a specific neurobiological architecture, approximating the operation of a slow serial Turing machine. We review recent progress in understanding how the brain implements such multi-step decisions and briefly examine how they might be realized in models of primate cortex.

[1]  Pierre Jolickur.  Concurrent Response-Selection Demands Modulate the Attentional Blink , 1999 .

[2]  P. Jolicoeur.  Restricted attentional capacity between sensory modalities , 1999, Psychonomic bulletin & review.

[3]  A. Turing.  On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[4]  A. Welford.  THE ‘PSYCHOLOGICAL REFRACTORY PERIOD’ AND THE TIMING OF HIGH‐SPEED PERFORMANCE—A REVIEW AND A THEORY , 1952 .

[5]  Etienne Koechlin,et al.  Divided Representation of Concurrent Goals in the Human Frontal Lobes , 2010, Science.

[6]  John Duncan,et al.  Assembly and Use of New Task Rules in Fronto-parietal Cortex , 2011, Journal of Cognitive Neuroscience.

[7]  M. Sigman,et al.  Brain Mechanisms of Serial and Parallel Processing during Dual-Task Performance , 2008, The Journal of Neuroscience.

[8]  Stephanie Westendorff,et al.  Implementation of Spatial Transformation Rules for Goal-Directed Reaching via Gain Modulation in Monkey Parietal and Premotor Cortex , 2009, The Journal of Neuroscience.

[9]  C. Summerfield,et al.  An information theoretical approach to prefrontal executive function , 2007, Trends in Cognitive Sciences.

[10]  M. Kerszberg,et al.  A Neuronal Model of a Global Workspace in Effortful Cognitive Tasks , 2001 .

[11]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[12]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[13]  Michael N. Shadlen,et al.  Probabilistic reasoning by neurons , 2007, Nature.

[14]  J. Changeux,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.5 May 2006 Conscious, preconscious, and subliminal processing: a testable taxonomy , 2022 .

[15]  Jonathan D. Cohen,et al.  Prefrontal cortex and flexible cognitive control: rules without symbols. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[16]  P. Jolicoeur,et al.  Central processing overlap modulates P3 latency , 2005, Experimental Brain Research.

[17]  Mariano Sigman,et al.  Parsing a sequence of brain activations at psychological times using fMRI , 2007, NeuroImage.

[18]  J. Tanji,et al.  Categorization of behavioural sequences in the prefrontal cortex , 2007, Nature.

[19]  E. Koechlin,et al.  Anterior Prefrontal Function and the Limits of Human Decision-Making , 2007, Science.

[20]  J. Gold,et al.  Banburismus and the Brain Decoding the Relationship between Sensory Stimuli, Decisions, and Reward , 2002, Neuron.

[21]  L. Selen,et al.  Deliberation in the Motor System: Reflex Gains Track Evolving Evidence Leading to a Decision , 2012, The Journal of Neuroscience.

[22]  C. Gilbert,et al.  Top-Down Reorganization of Activity in the Visual Pathway after Learning a Shape Identification Task , 2005, Neuron.

[23]  Geraint Rees,et al.  Relating Introspective Accuracy to Individual Differences in Brain Structure , 2010, Science.

[24]  Alan S. Brown,et al.  Information Processing and Cognition: The Loyola Symposium , 1976 .

[25]  S. Dehaene,et al.  Causal role of prefrontal cortex in the threshold for access to consciousness. , 2009, Brain : a journal of neurology.

[26]  P. Schoenemann,et al.  Prefrontal white matter volume is disproportionately larger in humans than in other primates , 2005, Nature Neuroscience.

[27]  J. Kalaska,et al.  Neural Correlates of Reaching Decisions in Dorsal Premotor Cortex: Specification of Multiple Direction Choices and Final Selection of Action , 2005, Neuron.

[28]  E. Koechlin,et al.  The Architecture of Cognitive Control in the Human Prefrontal Cortex , 2003, Science.

[29]  W. G. Koster,et al.  The psychological refractory period , 1966 .

[30]  J. Miller.  Discrete versus continuous stage models of human information processing: in search of partial output. , 1982, Journal of experimental psychology. Human perception and performance.

[31]  A M Graybiel,et al.  Time-varying covariance of neural activities recorded in striatum and frontal cortex as monkeys perform sequential-saccade tasks. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Pieter R Roelfsema,et al.  Surfing the attentional waves during visual curve tracing: evidence from the sustained posterior contralateral negativity. , 2011, Psychophysiology.

[33]  Stanislas Dehaene,et al.  Limits on Introspection Distorted Subjective Time During the Dual-Task Bottleneck , 2008 .

[34]  D. Wolpert,et al.  Changing your mind: a computational mechanism of vacillation , 2009, Nature.

[35]  E. Vogel,et al.  Electrophysiological Evidence for a Postperceptual Locus of Suppression during the Attentional Blink Time-based Attention and the Attentional Blink , 1998 .

[36]  R. Verleger,et al.  P3 latency shifts in the attentional blink: Further evidence for second target processing postponement , 2007, Brain Research.

[37]  John Duncan,et al.  Fluid intelligence loss linked to restricted regions of damage within frontal and parietal cortex , 2010, Proceedings of the National Academy of Sciences.

[38]  H Pashler,et al.  Processing stages in overlapping tasks: evidence for a central bottleneck. , 1984, Journal of experimental psychology. Human perception and performance.

[39]  Stanislas Dehaene,et al.  Mapping introspection’s blind spot: Reconstruction of dual-task phenomenology using quantified introspection , 2010, Cognition.

[40]  J. Duncan.  The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour , 2010, Trends in Cognitive Sciences.

[41]  John Duncan,et al.  Hierarchical coding for sequential task events in the monkey prefrontal cortex , 2008, Proceedings of the National Academy of Sciences.

[42]  C. Gilbert,et al.  Brain States: Top-Down Influences in Sensory Processing , 2007, Neuron.

[43]  Eric-Jan Wagenmakers,et al.  An EZ-diffusion model for response time and accuracy , 2007, Psychonomic bulletin & review.

[44]  Guillaume Flandin,et al.  Probing the cortical network underlying the psychological refractory period: A combined EEG–fMRI study , 2011, NeuroImage.

[45]  Pieter R Roelfsema,et al.  Subtask sequencing in the primary visual cortex , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[46]  R. Marois,et al.  Capacity limits of information processing in the brain , 2005, Trends in Cognitive Sciences.

[47]  Stanislas Dehaene,et al.  The cost of serially chaining two cognitive operations , 2012, Psychological research.

[48]  J. Allman,et al.  Book Review: Two Phylogenetic Specializations in the Human Brain , 2002, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[49]  Kin Fai Ellick Wong.  The Relationship between Attentional Blink and Psychological Refractory Period , 2002 .

[50]  Christopher L Asplund,et al.  Surprise-induced blindness: a stimulus-driven attentional limit to conscious perception. , 2010, Journal of experimental psychology. Human perception and performance.

[51]  H. Pashler.  Dual-task interference in simple tasks: data and theory. , 1994, Psychological bulletin.

[52]  V. Lamme,et al.  How Awareness Changes the Relative Weights of Evidence During Human Decision-Making , 2011, PLoS biology.

[53]  Alicia M. Helion,et al.  Dissociating sources of dual-task interference using human electrophysiology , 2004, Psychonomic bulletin & review.

[54]  M. Sigman,et al.  Parsing a Cognitive Task: A Characterization of the Mind's Bottleneck , 2005, PLoS biology.

[55]  Timothy D. Hanks,et al.  Neurobiology of decision making: An intentional framework , 2008 .

[56]  J. Enns,et al.  What’s new in visual masking? , 2000, Trends in Cognitive Sciences.

[57]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[58]  J. Changeux,et al.  Experimental and Theoretical Approaches to Conscious Processing , 2011, Neuron.

[59]  R. Romo,et al.  Decoding a Perceptual Decision Process across Cortex , 2010, Neuron.

[60]  John Duncan,et al.  Executive function and fluid intelligence after frontal lobe lesions , 2009, Brain : a journal of neurology.

[61]  John von Neumann,et al.  The Computer and the Brain , 1960 .

[62]  Christopher L. Asplund,et al.  A Unified attentional bottleneck in the human brain , 2011, Proceedings of the National Academy of Sciences.

[63]  Rolf Ulrich,et al.  Decomposing sources of response slowing in the PRP paradigm. , 2007, Journal of experimental psychology. Human perception and performance.

[64]  Jun Tanji,et al.  Development of Multidimensional Representations of Task Phases in the Lateral Prefrontal Cortex , 2011, The Journal of Neuroscience.

[65]  Pieter R. Roelfsema,et al.  The Brain's Router: A Cortical Network Model of Serial Processing in the Primate Brain , 2010, PLoS Comput. Biol..

[66]  E. Vogel,et al.  Delayed working memory consolidation during the attentional blink , 2002, Psychonomic bulletin & review.

[67]  A. Graybiel,et al.  Representation of Action Sequence Boundaries by Macaque Prefrontal Cortical Neurons , 2003, Science.

[68]  G. Sperling,et al.  Information transfer in iconic memory experiments. , 1993, Journal of experimental psychology. Human perception and performance.

[69]  P. Jolicoeur,et al.  A central capacity sharing model of dual-task performance. , 2003, Journal of experimental psychology. Human perception and performance.

[70]  Biyu J. He,et al.  The Temporal Structures and Functional Significance of Scale-free Brain Activity , 2010, Neuron.

[71]  G D Logan,et al.  Parallel memory retrieval in dual-task situations: I. Semantic memory. , 2000, Journal of experimental psychology. Human perception and performance.

[72]  M. Posner,et al.  Attention and cognitive control. , 1975 .

[73]  Harold Pashler,et al.  Effects of practice on task architecture: Combined evidence from interference experiments and random-walk models of decision making , 2011, Cognition.

[74]  M. Sigman,et al.  The human Turing machine: a neural framework for mental programs , 2011, Trends in Cognitive Sciences.

[75]  Mariano Sigman,et al.  A shared cortical bottleneck underlying Attentional Blink and Psychological Refractory Period , 2012, NeuroImage.

[76]  J. Kalaska,et al.  Modulation of preparatory neuronal activity in dorsal premotor cortex due to stimulus-response compatibility. , 1994, Journal of neurophysiology.

[77]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.

[78]  W. Singer,et al.  Better than conscious? : decision making, the human mind, and implications for institutions , 2008 .

[79]  Pieter R Roelfsema,et al.  Neuronal Activity in the Visual Cortex Reveals the Temporal Order of Cognitive Operations , 2010, The Journal of Neuroscience.

[80]  G. Elston,et al.  The Pyramidal Cell in Cognition: A Comparative Study in Human and Monkey , 2001, The Journal of Neuroscience.

[81]  Christopher L. Asplund,et al.  Isolation of a Central Bottleneck of Information Processing with Time-Resolved fMRI , 2006, Neuron.

[82]  Stanislas Dehaene,et al.  Accumulation of Evidence during Sequential Decision Making: The Importance of Top–Down Factors , 2010, The Journal of Neuroscience.

[83]  S Ullman,et al.  Visual curve tracing properties. , 1991, Journal of experimental psychology. Human perception and performance.

[84]  Kimron Shapiro,et al.  Modulation of long-range neural synchrony reflects temporal limitations of visual attention in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[85]  C. W. Telford.  The refractory phase of voluntary and associative responses , 1931 .

[86]  F. Tong,et al.  Training Improves Multitasking Performance by Increasing the Speed of Information Processing in Human Prefrontal Cortex , 2009, Neuron.

[87]  S. Dehaene,et al.  Timing of the brain events underlying access to consciousness during the attentional blink , 2005, Nature Neuroscience.

[88]  Eric Ruthruff,et al.  Dual-task performance with ideomotor-compatible tasks: is the central processing bottleneck intact, bypassed, or shifted in locus? , 2005, Journal of experimental psychology. Human perception and performance.

[89]  M. Potter,et al.  Temporal constraints on conscious vision: on the ubiquitous nature of the attentional blink. , 2009, Journal of vision.

[90]  Stanislas Dehaene,et al.  The cognitive architecture for chaining of two mental operations , 2009, Cognition.

[91]  M. Sigman,et al.  Dynamics of the Central Bottleneck: Dual-Task and Task Uncertainty , 2006, PLoS biology.

[92]  H Spekreijse,et al.  A Neural Correlate of Working Memory in the Monkey Primary Visual Cortex , 2001, Science.

[93]  Victor A. F. Lamme,et al.  The implementation of visual routines , 2000, Vision Research.

[94]  Eric Ruthruff,et al.  Confirming and disconfirming theories about ideomotor compatibility in dual-task performance: a reply to Greenwald (2005). , 2005, Journal of experimental psychology. Human perception and performance.

[95]  Robert W Proctor,et al.  Is the psychological refractory period effect for ideomotor compatible tasks eliminated by speed-stress instructions? , 2007, Psychological research.

[96]  A. Turing,et al.  On Computable Numbers, with an Application to the Entscheidungsproblem. A Correction , 1938 .

[97]  E. Koechlin,et al.  The role of the anterior prefrontal cortex in human cognition , 1999, Nature.