Eye Gaze Reveals a Fast, Parallel Extraction of the Syntax of Arithmetic Formulas

Mathematics shares with language an essential reliance on the human capacity for recursion, permitting the generation of an infinite range of embedded expressions from a finite set of symbols. We studied the role of syntax in arithmetic thinking, a neglected component of numerical cognition, by examining eye movement sequences during the calculation of arithmetic expressions. Specifically, we investigated whether, similar to language, an expression has to be scanned sequentially while the nested syntactic structure is being computed or, alternatively, whether this structure can be extracted quickly and in parallel. Our data provide evidence for the latter: fixations sequences were stereotypically organized in clusters that reflected a fast identification of syntactic embeddings. A syntactically relevant pattern of eye movement was observed even when syntax was defined by implicit procedural rules (precedence of multiplication over addition) rather than explicit parentheses. While the total number of fixations was determined by syntax, the duration of each fixation varied with the complexity of the arithmetic operation at each step. These findings provide strong evidence for a syntactic organization for arithmetic thinking, paving the way for further comparative analysis of differences and coincidences in the instantiation of recursion in language and mathematics.

[1]  M. Ranney,et al.  The role of structural context in perception: Syntax in the recognition of algebraic expressions , 1987, Memory & cognition.

[2]  Robert L. Goldstone,et al.  Reuniting perception and conception , 1998, Cognition.

[3]  Paul Ernest A MODEL OF THE COGNITIVE MEANING OF MATHEMATICAL EXPRESSIONS , 1987 .

[4]  Yosef Grodzinsky,et al.  Neuroimaging of syntax and syntactic processing , 2006, Current Opinion in Neurobiology.

[5]  L. Timmers,et al.  The generality of mental addition models: Simple and complex addition in a decision-production task , 1990, Memory & Cognition.

[6]  G. Waters,et al.  Working memory and written sentence comprehension , 1987 .

[7]  Noam Chomsky Reflections on Language. , 1977 .

[8]  Tom Michael Mitchell,et al.  Predicting Human Brain Activity Associated with the Meanings of Nouns , 2008, Science.

[9]  Robert L. Goldstone,et al.  Formal notations are diagrams: Evidence from a production task , 2007, Memory & cognition.

[10]  Patricia E. Blosser,et al.  Principles of gestalt psychology and their application to teaching junior high school science , 1973 .

[11]  G. A. Miller,et al.  Finitary models of language users , 1963 .

[12]  D. McDermott LANGUAGE OF THOUGHT , 2012 .

[13]  Florian Cajori,et al.  A history of mathematical notations , 1928 .

[14]  M. Wertheimer Laws of organization in perceptual forms. , 1938 .

[15]  Martin A. Nowak,et al.  The evolution of syntactic communication , 2000, Nature.

[16]  Robert L. Goldstone,et al.  How abstract is symbolic thought? , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[17]  S. Dehaene,et al.  Cultural Recycling of Cortical Maps , 2007, Neuron.

[18]  C. Gilbert,et al.  Learning to find a shape , 2000, Nature Neuroscience.

[19]  Ralf Engbert,et al.  Tracking the mind during reading: the influence of past, present, and future words on fixation durations. , 2006, Journal of experimental psychology. General.

[20]  K. Koffka Principles Of Gestalt Psychology , 1936 .

[21]  Aniruddh D. Patel,et al.  Language, music, syntax and the brain , 2003, Nature Neuroscience.

[22]  Robert L. Goldstone,et al.  Proximity and Precedence in Arithmetic , 2010, Quarterly journal of experimental psychology.

[23]  Noam Chomsky,et al.  Language and problems of knowledge : the Managua lectures , 1990 .

[24]  M. Ashcraft,et al.  Menatal addition: A test of three verification models , 1981, Memory & cognition.

[25]  Noam Chomsky,et al.  The faculty of language: what is it, who has it, and how did it evolve? , 2002 .

[26]  Y. Grodzinsky,et al.  The Neurology of Empty Categories: Aphasics' Failure to Detect Ungrammaticality , 1998, Journal of Cognitive Neuroscience.

[27]  C. Gilbert,et al.  The Neural Basis of Perceptual Learning , 2001, Neuron.

[28]  M. Ashcraft Cognitive arithmetic: A review of data and theory , 1992, Cognition.

[29]  P Cormier,et al.  A componential model for mental addition. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[30]  Noam Chomsky,et al.  The Minimalist Program , 1992 .

[31]  David H. Kirshner The Visual Syntax of Algebra. , 1989 .

[32]  K. Rayner,et al.  Eye Movements in Reading: Perceptual and Language Processes , 1985 .

[33]  Eugene Galanter,et al.  Handbook of mathematical psychology: I. , 1963 .

[34]  J. R. Pomerantz,et al.  Why is language unique to humans ? , 2008 .

[35]  Robert L. Goldstone,et al.  How the Appearance of an Operator Affects its Formal Precedence , 2008 .

[36]  Pieter R. Roelfsema,et al.  The Brain's Router: A Cortical Network Model of Serial Processing in the Primate Brain , 2010, PLoS Comput. Biol..

[37]  Robert L. Goldstone,et al.  The Education of Perception , 2010, Top. Cogn. Sci..

[38]  R. Jackendoff,et al.  A Generative Theory of Tonal Music , 1985 .

[39]  Kim Marriott,et al.  Comprehension of Algebraic Expressions by Experienced users of Mathematics , 2003, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[40]  G. Waters,et al.  On the Structure of Verbal Short-term Memory and its Functional Role in Sentence Comprehension: Evidence from Neuropsychology , 1991 .

[41]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[42]  G. Westheimer Gestalt Theory Reconfigured: Max Wertheimer's Anticipation of Recent Developments in Visual Neuroscience , 1999, Perception.

[43]  Lyn Frazier,et al.  Semantic evaluation of syntactic structure: Evidence from eye movements , 2006, Cognition.

[44]  F. J. Friedrich,et al.  Effects of parietal injury on covert orienting of attention , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  Reinhold Kliegl,et al.  Toward a Perceptual-Span Theory of Distributed Processing in Reading: A Reply to Rayner, Pollatsek, Drieghe, Slattery, and Reichle (2007). , 2007 .

[46]  K. Rayner,et al.  Extraction of information to the left of the fixated word in reading. , 1999, Journal of experimental psychology. Human perception and performance.

[47]  Denise Brandão de Oliveira e Britto,et al.  The faculty of language , 2007 .

[48]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[49]  T. Hendler,et al.  The Neural Reality of Syntactic Transformations , 2003, Psychological science.

[50]  A. Turing On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[51]  C. Gilbert,et al.  On a common circle: natural scenes and Gestalt rules. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[52]  M. Sigman,et al.  Parsing a Cognitive Task: A Characterization of the Mind's Bottleneck , 2005, PLoS biology.

[53]  Y. Grodzinsky The neurology of syntax: Language use without Broca's area , 2000, Behavioral and Brain Sciences.

[54]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[55]  Noam Chomsky,et al.  The faculty of language: what is it, who has it, and how did it evolve? , 2002, Science.

[56]  M. Brysbaert,et al.  Eye Movement Control during Reading: Foveal Load and Parafoveal Processing , 1999, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[57]  D E Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 1. Basic mechanisms. , 1997, Psychological review.