Representation of spatial sequences using nested rules in human prefrontal cortex

&NA; Memory for spatial sequences does not depend solely on the number of locations to be stored, but also on the presence of spatial regularities. Here, we show that the human brain quickly stores spatial sequences by detecting geometrical regularities at multiple time scales and encoding them in a format akin to a programming language. We measured gaze‐anticipation behavior while spatial sequences of variable regularity were repeated. Participants' behavior suggested that they quickly discovered the most compact description of each sequence in a language comprising nested rules, and used these rules to compress the sequence in memory and predict the next items. Activity in dorsal inferior prefrontal cortex correlated with the amount of compression, while right dorsolateral prefrontal cortex encoded the presence of embedded structures. Sequence learning was accompanied by a progressive differentiation of multi‐voxel activity patterns in these regions. We propose that humans are endowed with a simple “language of geometry” which recruits a dorsal prefrontal circuit for geometrical rules, distinct from but close to areas involved in natural language processing.

[1]  Theresa M. Desrochers,et al.  The Necessity of Rostrolateral Prefrontal Cortex for Higher-Level Sequential Behavior , 2015, Neuron.

[2]  Patrick R Hof,et al.  Broca's area homologue in chimpanzees (Pan troglodytes): probabilistic mapping, asymmetry, and comparison to humans. , 2009, Cerebral cortex.

[3]  Timothy E. J. Behrens,et al.  The evolution of the arcuate fasciculus revealed with comparative DTI , 2008, Nature Neuroscience.

[4]  Adam G. Thomas,et al.  Comparison of Human Ventral Frontal Cortex Areas for Cognitive Control and Language with Areas in Monkey Frontal Cortex , 2014, Neuron.

[5]  D. Hassabis,et al.  Neural Mechanisms of Hierarchical Planning in a Virtual Subway Network , 2016, Neuron.

[6]  Chet C. Sherwood,et al.  Exceptional Evolutionary Expansion of Prefrontal Cortex in Great Apes and Humans , 2017, Current Biology.

[7]  M. Buiatti,et al.  Electrophysiological evidence of statistical learning of long-distance dependencies in 8-month-old preterm and full-term infants , 2015, Brain and Language.

[8]  J L Lancaster,et al.  Automated Talairach Atlas labels for functional brain mapping , 2000, Human brain mapping.

[9]  W Tecumseh Fitch,et al.  Toward a computational framework for cognitive biology: unifying approaches from cognitive neuroscience and comparative cognition. , 2014, Physics of life reviews.

[10]  Edward E. Smith,et al.  A Parametric Study of Prefrontal Cortex Involvement in Human Working Memory , 1996, NeuroImage.

[11]  S Dehaene,et al.  A hierarchical neuronal network for planning behavior. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[12]  W. Fitch,et al.  Computational Constraints on Syntactic Processing in a Nonhuman Primate , 2004, Science.

[13]  Mark D'Esposito,et al.  The hierarchical organization of the lateral prefrontal cortex , 2016, eLife.

[14]  S. Dehaene,et al.  Representation of Numerical and Sequential Patterns in Macaque and Human Brains , 2015, Current Biology.

[15]  Alfred Anwander,et al.  Segregating the core computational faculty of human language from working memory , 2009, Proceedings of the National Academy of Sciences.

[16]  B. Thirion,et al.  Fast reproducible identification and large-scale databasing of individual functional cognitive networks , 2007, BMC Neuroscience.

[17]  William D. Marslen-Wilson,et al.  Conserved Sequence Processing in Primate Frontal Cortex , 2017, Trends in Neurosciences.

[18]  Denise M Werchan,et al.  Role of Prefrontal Cortex in Learning and Generalizing Hierarchical Rules in 8-Month-Old Infants , 2016, The Journal of Neuroscience.

[19]  M. D’Esposito,et al.  Frontal Cortex and the Discovery of Abstract Action Rules , 2010, Neuron.

[20]  P. Greenfield,et al.  Language, tools and brain: The ontogeny and phylogeny of hierarchically organized sequential behavior , 1991, Behavioral and Brain Sciences.

[21]  R. Aslin,et al.  Statistical learning in a serial reaction time task: access to separable statistical cues by individual learners. , 2001, Journal of experimental psychology. General.

[22]  M. D’Esposito,et al.  Is the rostro-caudal axis of the frontal lobe hierarchical? , 2009, Nature Reviews Neuroscience.

[23]  Mariano Sigman,et al.  LT^2C^2: A language of thought with Turing-computable Kolmogorov complexity , 2013, ArXiv.

[24]  E. Koechlin,et al.  The Architecture of Cognitive Control in the Human Prefrontal Cortex , 2003, Science.

[25]  Les Staves About number sense , 2018, Very Special Maths.

[26]  I. Vetter,et al.  The Evolution of Fangs, Venom, and Mimicry Systems in Blenny Fishes , 2017, Current Biology.

[27]  Florent Meyniel,et al.  The Neural Representation of Sequences: From Transition Probabilities to Algebraic Patterns and Linguistic Trees , 2015, Neuron.

[28]  K. Lashley The problem of serial order in behavior , 1951 .

[29]  E. Koechlin,et al.  Broca's Area and the Hierarchical Organization of Human Behavior , 2006, Neuron.

[30]  W. Marslen-Wilson,et al.  Auditory sequence processing reveals evolutionarily conserved regions of frontal cortex in macaques and humans , 2015, Nature Communications.

[31]  Noam Chomsky,et al.  The faculty of language: what is it, who has it, and how did it evolve? , 2002, Science.

[32]  Kim Marriott,et al.  Comprehension of Algebraic Expressions by Experienced users of Mathematics , 2003, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[33]  Peter M. Vishton,et al.  Rule learning by seven-month-old infants. , 1999, Science.

[34]  Mariano Sigman,et al.  The cortical representation of simple mathematical expressions , 2012, NeuroImage.

[35]  M. Sigman,et al.  Functional organization of perisylvian activation during presentation of sentences in preverbal infants , 2006, Proceedings of the National Academy of Sciences.

[36]  Hyeon-Ae Jeon,et al.  Hierarchical processing in the prefrontal cortex in a variety of cognitive domains , 2014, Front. Syst. Neurosci..

[37]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[38]  Stanislas Dehaene,et al.  Origins of the brain networks for advanced mathematics in expert mathematicians , 2016, Proceedings of the National Academy of Sciences.

[39]  S. Dehaene,et al.  A hierarchy of cortical responses to sequence violations in three-month-old infants , 2014, Cognition.

[40]  Mark D'Esposito,et al.  The Rostro-Caudal Axis of Frontal Cortex Is Sensitive to the Domain of Stimulus Information. , 2015, Cerebral cortex.

[41]  Angela D. Friederici,et al.  Artificial grammar learning meets formal language theory: an overview , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[42]  Mariano Sigman,et al.  The language of geometry: Fast comprehension of geometrical primitives and rules in human adults and preschoolers , 2017, PLoS Comput. Biol..

[43]  Michael Siegal,et al.  Agrammatic but numerate. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[44]  R. O’Reilly The What and How of prefrontal cortical organization , 2010, Trends in Neurosciences.

[45]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[46]  Elger L. Abrahamse,et al.  Cognitive Processing in New and Practiced Discrete Keying Sequences , 2010, Front. Psychology.

[47]  Stanislas Dehaene,et al.  Cortical circuits for mathematical knowledge: evidence for a major subdivision within the brain's semantic networks , 2018, Philosophical Transactions of the Royal Society B: Biological Sciences.

[48]  Stanislas Dehaene,et al.  Eye Gaze Reveals a Fast, Parallel Extraction of the Syntax of Arithmetic Formulas , 2022 .

[49]  Darryl W. Schneider,et al.  Hierarchical control of cognitive processes: switching tasks in sequences. , 2006, Journal of experimental psychology. General.

[50]  S. Dehaene,et al.  Cortical representation of the constituent structure of sentences , 2011, Proceedings of the National Academy of Sciences.

[51]  J. Duncan,et al.  Encoding Strategies Dissociate Prefrontal Activity from Working Memory Demand , 2003, Neuron.

[52]  David Badre,et al.  Frontal Cortex and the Hierarchical Control of Behavior , 2018, Trends in Cognitive Sciences.

[53]  J. Saffran,et al.  From Syllables to Syntax: Multilevel Statistical Learning by 12-Month-Old Infants , 2003 .

[54]  Aniruddh D. Patel,et al.  Language, music, syntax and the brain , 2003, Nature Neuroscience.

[55]  D A Rosenbaum,et al.  Hierarchical control of rapid movement sequences. , 1983, Journal of experimental psychology. Human perception and performance.

[56]  C. Wendelken,et al.  Rostrolateral prefrontal cortex: Domain‐general or domain‐sensitive? , 2012, Human brain mapping.

[57]  J. Tenenbaum,et al.  Word learning as Bayesian inference. , 2007, Psychological review.

[58]  C. Summerfield,et al.  An information theoretical approach to prefrontal executive function , 2007, Trends in Cognitive Sciences.