The cognitive architecture for chaining of two mental operations

A simple view, which dates back to Turing, proposes that complex cognitive operations are composed of serially arranged elementary operations, each passing intermediate results to the next. However, whether and how such serial processing is achieved with a brain composed of massively parallel processors, remains an open question. Here, we study the cognitive architecture for chained operations with an elementary arithmetic algorithm: we required participants to add (or subtract) two to a digit, and then compare the result with five. In four experiments, we probed the internal implementation of this task with chronometric analysis, the cued-response method, the priming method, and a subliminal forced-choice procedure. We found evidence for an approximately sequential processing, with an important qualification: the second operation in the algorithm appears to start before completion of the first operation. Furthermore, initially the second operation takes as input the stimulus number rather than the output of the first operation. Thus, operations that should be processed serially are in fact executed partially in parallel. Furthermore, although each elementary operation can proceed subliminally, their chaining does not occur in the absence of conscious perception. Overall, the results suggest that chaining is slow, effortful, imperfect (resulting partly in parallel rather than serial execution) and dependent on conscious control.

[1]  L. A. Jeffress,et al.  Cerebral Mechanisms in Behavior , 1953 .

[2]  Allen Newell,et al.  Production Systems: Models of Control Structures , 1973 .

[3]  John R. Anderson,et al.  Serial modules in parallel: the psychological refractory period and perfect time-sharing. , 2001, Psychological review.

[4]  W. Chase,et al.  Visual information processing. , 1974 .

[5]  Stanislas Dehaene,et al.  Long-term semantic memory versus contextual memory in unconscious number processing. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[6]  Jeff Miller,et al.  Backward crosstalk effects in psychological refractory period paradigms: effects of second-task response types on first-task response latencies , 2006, Psychological research.

[7]  Gordon D. Logan,et al.  Parallel memory retrieval in dual-task situations: II. Episodic memory. , 2001 .

[8]  A. Battersby Plans and the Structure of Behavior , 1968 .

[9]  J. Changeux,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.5 May 2006 Conscious, preconscious, and subliminal processing: a testable taxonomy , 2022 .

[10]  Philippe Pinel,et al.  Tuning Curves for Approximate Numerosity in the Human Intraparietal Sulcus , 2004, Neuron.

[11]  F. Craik,et al.  Depth of processing and the retention of words , 1975 .

[12]  Colin M. Macleod Half a century of research on the Stroop effect: an integrative review. , 1991, Psychological bulletin.

[13]  A. Welford THE ‘PSYCHOLOGICAL REFRACTORY PERIOD’ AND THE TIMING OF HIGH‐SPEED PERFORMANCE—A REVIEW AND A THEORY , 1952 .

[14]  S. Ullman Visual routines , 1984, Cognition.

[15]  M. Manosevitz,et al.  High-Speed Scanning in Human Memory , 2022 .

[16]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[17]  James L. McClelland On the time relations of mental processes: An examination of systems of processes in cascade. , 1979 .

[18]  Stanislas Dehaene,et al.  Cerebral Pathways for Calculation: Double Dissociation between Rote Verbal and Quantitative Knowledge of Arithmetic , 1997, Cortex.

[19]  G. Logan Shapes of reaction-time distributions and shapes of learning curves: a test of the instance theory of automaticity. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[20]  Jeffrey Bisanz,et al.  Cognitive arithmetic: Evidence for obligatory activation of arithmetic facts , 1988, Memory & cognition.

[21]  S. Dehaene,et al.  Is Consciousness a Gradual Phenomenon? , 2004, Psychological science.

[22]  Myeong-Ho Sohn,et al.  Implicit temporal tuning of working memory strategy during cognitive skill acquisition. , 2003, The American journal of psychology.

[23]  J. C. Johnston,et al.  Attentional limitations in dual-task performance. , 1998 .

[24]  U. Neisser VISUAL SEARCH. , 1964, Scientific American.

[25]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[26]  S. Sternberg The discovery of processing stages , 1969 .

[27]  C. W. Telford The refractory phase of voluntary and associative responses , 1931 .

[28]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[29]  J Miller,et al.  Electrophysiological evidence for temporal overlap among contingent mental processes. , 1992, Journal of experimental psychology. General.

[30]  B. Dosher,et al.  Serial position and set size in short-term memory: The time course of recognition , 1989 .

[31]  J R Anderson,et al.  Task preparation and task repetition: two-component model of task switching. , 2001, Journal of experimental psychology. General.

[32]  S. Dehaene,et al.  Unconscious Masked Priming Depends on Temporal Attention , 2002, Psychological science.

[33]  W. Perrig,et al.  The influence of intention on masked priming: A study with semantic classification of words , 2007, Cognition.

[34]  Ronald A. Rensink,et al.  Competition for consciousness among visual events: the psychophysics of reentrant visual processes. , 2000, Journal of experimental psychology. General.

[35]  John Anderson,et al.  An integrated theory of prospective time interval estimation: the role of cognition, attention, and learning. , 2007, Psychological review.

[36]  J. Hoffmann,et al.  Unconscious priming according to multiple S-R rules , 2007, Cognition.

[37]  J. H. Neely Semantic priming and retrieval from lexical memory: Roles of inhibitionless spreading activation and limited-capacity attention. , 1977 .

[38]  David E. Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 2. Accounts of psychological refractory-period phenomena. , 1997 .

[39]  John R. Anderson,et al.  Human Symbol Manipulation Within an Integrated Cognitive Architecture , 2005, Cogn. Sci..

[40]  D. Broadbent Perception and communication , 1958 .

[41]  Stanislas Dehaene,et al.  Approximate quantities and exact number words: dissociable systems , 2003, Neuropsychologia.

[42]  Saul Sternberg,et al.  The discovery of processing stages: Extensions of Donders' method , 1969 .

[43]  D. Meyer,et al.  Temporal properties of human information processing: Tests of discrete versus continuous models , 1985, Cognitive Psychology.

[44]  Philippe Pinel,et al.  Distributed and Overlapping Cerebral Representations of Number, Size, and Luminance during Comparative Judgments , 2004, Neuron.

[45]  Stephani Foraker,et al.  Memory structures that subserve sentence comprehension , 2003 .

[46]  J. Schwarzbach,et al.  Different time courses for visual perception and action priming , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[47]  J. Hoffmann,et al.  Conscious control over the content of unconscious cognition , 2003, Cognition.

[48]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[49]  Ken Thompson,et al.  The UNIX time-sharing system , 1974, CACM.

[50]  Stanislas Dehaene,et al.  Preserved subliminal processing and impaired conscious access in schizophrenia. , 2006, Archives of general psychiatry.

[51]  K. Lashley The problem of serial order in behavior , 1951 .

[52]  Allen Newell,et al.  Physical Symbol Systems , 1980, Cogn. Sci..

[53]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[54]  John R. Anderson,et al.  The change of the brain activation patterns as children learn algebra equation solving. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[55]  G. Miller,et al.  Plans and the structure of behavior , 1960 .

[56]  B. Hommel Automatic stimulus-response translation in dual-task performance. , 1998, Journal of experimental psychology. Human perception and performance.

[57]  M G Coles,et al.  On the transmission of partial information: inferences from movement-related brain potentials. , 1992, Journal of experimental psychology. Human perception and performance.

[58]  T Shallice,et al.  Dual functions of consciousness. , 1972, Psychological review.

[59]  G D Logan,et al.  Parallel memory retrieval in dual-task situations: II. Episodic memory. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[60]  S. Sternberg,et al.  Separate modifiability, mental modules, and the use of pure and composite measures to reveal them. , 2001, Acta psychologica.

[61]  Jonathan D. Cohen,et al.  The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. , 2006, Psychological review.

[62]  J. Miller A queue-series model for reaction time, with discrete-stage and continuous-flow models as special cases. , 1993, Psychological review.

[63]  L. Reder,et al.  What determines initial feeling of knowing? Familiarity with question terms, not with the answer , 1992 .

[64]  J. Stroop Studies of interference in serial verbal reactions. , 1992 .

[65]  Thomas K. Landauer,et al.  Determinants of reaction time for digit inequality judgments , 1973 .

[66]  Rolf Ulrich,et al.  Donders's assumption of pure insertion: an evaluation on the basis of response dynamics , 1999 .

[67]  J. Enns Object substitution and its relation to other forms of visual masking , 2004, Vision Research.

[68]  M. Sigman,et al.  Parsing a Cognitive Task: A Characterization of the Mind's Bottleneck , 2005, PLoS biology.

[69]  S. Dehaene,et al.  Timing of the brain events underlying access to consciousness during the attentional blink , 2005, Nature Neuroscience.

[70]  B. Baars The conscious access hypothesis: origins and recent evidence , 2002, Trends in Cognitive Sciences.

[71]  Pierre Jolicoeur,et al.  Testing the predictions of the central capacity sharing model. , 2005, Journal of experimental psychology. Human perception and performance.

[72]  J Miller,et al.  A violation of pure insertion: mental rotation and choice reaction time. , 1994, Journal of experimental psychology. Human perception and performance.

[73]  S. Dehaene,et al.  Imaging unconscious semantic priming , 1998, Nature.

[74]  Jeff Miller,et al.  The asynchronous discrete coding model: Further tests with single-attribute stimuli , 1998, Perception & psychophysics.

[75]  Victor A. F. Lamme,et al.  The implementation of visual routines , 2000, Vision Research.

[76]  Refractor Vision , 2000, The Lancet.

[77]  G. Miller,et al.  Plans and the structure of behavior , 1960 .

[78]  H Pashler,et al.  Processing stages in overlapping tasks: evidence for a central bottleneck. , 1984, Journal of experimental psychology. Human perception and performance.

[79]  Donald Laming,et al.  Information theory of choice-reaction times , 1968 .

[80]  F. C. Donders La vitesse des actes psychiques , 1868 .

[81]  S. Dehaene,et al.  Abstract representations of numbers in the animal and human brain , 1998, Trends in Neurosciences.

[82]  Marco Steinhauser,et al.  Mixing costs in task shifting reflect sequential processing stages in a multicomponent task , 2005, Memory & cognition.

[83]  Gordon D Logan,et al.  An instance theory of attention and memory. , 2002, Psychological review.

[84]  J. Townsend,et al.  The serial-parallel dilemma: A case study in a linkage of theory and method , 2004, Psychonomic bulletin & review.

[85]  R. Passingham,et al.  Unconscious Activation of the Cognitive Control System in the Human Prefrontal Cortex , 2007, The Journal of Neuroscience.

[86]  ROBERT S. MOYER,et al.  Time required for Judgements of Numerical Inequality , 1967, Nature.

[87]  G. Logan Toward an instance theory of automatization. , 1988 .

[88]  Gordon D. Logan,et al.  Automatizing alphabet arithmetic: I. Is extended practice necessary to produce automaticity? , 1991 .

[89]  Jean,et al.  The Computer and the Brain , 1989, Annals of the History of Computing.

[90]  M. Posner,et al.  On the functions of consciousness , 1973 .

[91]  S. Dehaene,et al.  Towards a cognitive neuroscience of consciousness: basic evidence and a workspace framework , 2001, Cognition.

[92]  U. Mayr Age differences in the selection of mental sets: the role of inhibition, stimulus ambiguity, and response-set overlap. , 2001, Psychology and aging.

[93]  S. Dehaene,et al.  Brain Dynamics Underlying the Nonlinear Threshold for Access to Consciousness , 2007, PLoS biology.

[94]  B. Baars A cognitive theory of consciousness , 1988 .

[95]  A. Turing On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[96]  G D Logan,et al.  Parallel memory retrieval in dual-task situations: I. Semantic memory. , 2000, Journal of experimental psychology. Human perception and performance.

[97]  Allen Newell,et al.  Elements of a theory of human problem solving. , 1958 .

[98]  Stuart T. Klapp,et al.  Automatizing Alphabet Arithmetic : II . Are There Practice Effects After Automaticity Is Achieved ? , 1991 .

[99]  M. Stone Models for choice-reaction time , 1960 .

[100]  M. Kerszberg,et al.  A Neuronal Model of a Global Workspace in Effortful Cognitive Tasks , 2001 .

[101]  Tim Shallice,et al.  Introspective physicalism as an approach to the science of consciousness , 2001, Cognition.

[102]  K. R. Ridderinkhof,et al.  Frontal Cortex Mediates Unconsciously Triggered Inhibitory Control , 2008, The Journal of Neuroscience.

[103]  H. Pashler,et al.  Graded capacity-sharing in dual-task interference? , 1994, Journal of experimental psychology. Human perception and performance.

[104]  D E Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 1. Basic mechanisms. , 1997, Psychological review.

[105]  M. Botvinick Hierarchical models of behavior and prefrontal function , 2008, Trends in Cognitive Sciences.

[106]  A memory-based account of automatic numerosity processing , 2005, Memory & cognition.

[107]  S. C. Kleene,et al.  Introduction to Metamathematics , 1952 .

[108]  Jeff Miller,et al.  Backward response-level crosstalk in the psychological refractory period paradigm. , 2006, Journal of experimental psychology. Human perception and performance.

[109]  Emmanuel Dupoux,et al.  Expe: An expandable programming language for on-line psychological experiments , 1997 .

[110]  A. Church An Unsolvable Problem of Elementary Number Theory , 1936 .

[111]  P. Jolicoeur,et al.  A central capacity sharing model of dual-task performance. , 2003, Journal of experimental psychology. Human perception and performance.

[112]  M. Sigman,et al.  Dynamics of the Central Bottleneck: Dual-Task and Task Uncertainty , 2006, PLoS biology.

[113]  H. Pashler Dual-task interference in simple tasks: data and theory. , 1994, Psychological bulletin.