Decoding the representation of numerical values from brain activation patterns

Human neuroimaging studies have increasingly converged on the possibility that the neural representation of specific numbers may be decodable from brain activity, particularly in parietal cortex. Multivariate machine learning techniques have recently demonstrated that the neural representation of individual concrete nouns can be decoded from fMRI patterns, and that some patterns are general over people. Here we use these techniques to investigate whether the neural codes for quantities of objects can be accurately decoded. The pictorial mode (nonsymbolic) depicted a set of objects pictorially (e.g., a picture of three tomatoes), whereas the digit‐object mode depicted quantities as combination of a digit (e.g., 3) with a picture of a single object. The study demonstrated that quantities of objects were decodable from neural activation patterns, in parietal regions. These brain activation patterns corresponding to a given quantity were common across objects and across participants in the pictorial mode. Other important findings included better identification of individual numbers in the pictorial mode, partial commonality of neural patterns across the two modes, and hemispheric asymmetry with pictorially‐depicted numbers represented bilaterally and numbers in the digit‐object mode represented primarily in the left parietal regions. The findings demonstrate the ability to identify individual quantities of objects based on neural patterns, indicating the presence of stable neural representations of numbers. Additionally, they indicate a predominance of neural representation of pictorially depicted numbers over the digit‐object mode. Hum Brain Mapp 34:2624–2634, 2013. © 2012 Wiley Periodicals, Inc.

[1]  E. L. Kaufman,et al.  The discrimination of visual number. , 1949, The American journal of psychology.

[2]  ROBERT S. MOYER,et al.  Time required for Judgements of Numerical Inequality , 1967, Nature.

[3]  G. Mandler,et al.  Subitizing: an analysis of its component processes. , 1982, Journal of experimental psychology. General.

[4]  Z. Pylyshyn,et al.  What enumeration studies can show us about spatial attention: evidence for limited capacity preattentive processing. , 1993, Journal of experimental psychology. Human perception and performance.

[5]  S Dehaene,et al.  Attention, automaticity, and levels of representation in number processing. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[6]  Stanislas Dehaene,et al.  The Organization of Brain Activations in Number Comparison: Event-Related Potentials and the Additive-Factors Method , 1996, Journal of Cognitive Neuroscience.

[7]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[8]  S. Dehaene,et al.  The Number Sense: How the Mind Creates Mathematics. , 1998 .

[9]  S. Dehaene,et al.  Abstract representations of numbers in the animal and human brain , 1998, Trends in Neurosciences.

[10]  D. LeBihan,et al.  Modulation of Parietal Activation by Semantic Distance in a Number Comparison Task , 2001, NeuroImage.

[11]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[12]  S. Dehaene,et al.  The priming method: imaging unconscious repetition priming reveals an abstract representation of number in the parietal lobes. , 2001, Cerebral cortex.

[13]  S. Dehaene,et al.  Unconscious semantic priming extends to novel unseen stimuli , 2001, Cognition.

[14]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[15]  David J. Freedman,et al.  Representation of the Quantity of Visual Items in the Primate Prefrontal Cortex , 2002, Science.

[16]  E. Spelke,et al.  The construction of large number representations in adults , 2003, Cognition.

[17]  David D. Cox,et al.  Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex , 2003, NeuroImage.

[18]  A. Kleinschmidt,et al.  A Supramodal Number Representation in Human Intraparietal Cortex , 2003, Neuron.

[19]  G. Orban,et al.  Parietal Representation of Symbolic and Nonsymbolic Magnitude , 2003, Journal of Cognitive Neuroscience.

[20]  S. Dehaene,et al.  THREE PARIETAL CIRCUITS FOR NUMBER PROCESSING , 2003, Cognitive neuropsychology.

[21]  Stephen José Hanson,et al.  Combinatorial codes in ventral temporal lobe for object recognition: Haxby (2001) revisited: is there a “face” area? , 2004, NeuroImage.

[22]  Tom M. Mitchell,et al.  Learning to Decode Cognitive States from Brain Images , 2004, Machine Learning.

[23]  Wim Fias,et al.  Representation of Number in Animals and Humans: A Neural Model , 2004, Journal of Cognitive Neuroscience.

[24]  G. Rees,et al.  Predicting the orientation of invisible stimuli from activity in human primary visual cortex , 2005, Nature Neuroscience.

[25]  V Menon,et al.  Cerebral Cortex doi:10.1093/cercor/bhi055 Developmental Changes in Mental Arithmetic: Evidence for Increased Functional Specialization in the Left Inferior Parietal Cortex , 2005 .

[26]  Terence W. Picton,et al.  Effects of Attention on Neuroelectric Correlates of Auditory Stream Segregation , 2006, Journal of Cognitive Neuroscience.

[27]  E. J. Carter,et al.  Functional Imaging of Numerical Processing in Adults and 4-y-Old Children , 2006, PLoS biology.

[28]  Melissa E. Libertus,et al.  Electrophysiological evidence for notation independence in numerical processing , 2007, Behavioral and Brain Functions.

[29]  F. Tong,et al.  Decoding Seen and Attended Motion Directions from Activity in the Human Visual Cortex , 2006, Current Biology.

[30]  Avishai Henik,et al.  Notation-Dependent and -Independent Representations of Numbers in the Parietal Lobes , 2007, Neuron.

[31]  Daniel Ansari,et al.  Does the Parietal Cortex Distinguish between “10,” “Ten,” and Ten Dots? , 2007, Neuron.

[32]  Alice J. O'Toole,et al.  Theoretical, Statistical, and Practical Perspectives on Pattern-based Classification Approaches to the Analysis of Functional Neuroimaging Data , 2007, Journal of Cognitive Neuroscience.

[33]  S. Dehaene,et al.  A Magnitude Code Common to Numerosities and Number Symbols in Human Intraparietal Cortex , 2007, Neuron.

[34]  Christa Neuper,et al.  Individual differences in mathematical competence predict parietal brain activation during mental calculation , 2007, NeuroImage.

[35]  Margarete Delazer,et al.  Imaging early practice effects in arithmetic , 2007, NeuroImage.

[36]  Rainer Goebel,et al.  "Who" Is Saying "What"? Brain-Based Decoding of Human Voice and Speech , 2008, Science.

[37]  Tom Michael Mitchell,et al.  From the SelectedWorks of Marcel Adam Just 2008 Using fMRI brain activation to identify cognitive states associated with perception of tools and dwellings , 2016 .

[38]  Tom Michael Mitchell,et al.  Predicting Human Brain Activity Associated with the Meanings of Nouns , 2008, Science.

[39]  D. Ansari Effects of development and enculturation on number representation in the brain , 2008, Nature Reviews Neuroscience.

[40]  R. Cohen Kadosh,et al.  Numerical representation in the parietal lobes: abstract or not abstract? , 2009, The Behavioral and brain sciences.

[41]  Bertrand Thirion,et al.  Deciphering Cortical Number Coding from Human Brain Activity Patterns , 2009, Current Biology.

[42]  Daniel Ansari,et al.  Common and segregated neural pathways for the processing of symbolic and nonsymbolic numerical magnitude: An fMRI study , 2010, NeuroImage.

[43]  Anthony D. Wagner,et al.  Detecting individual memories through the neural decoding of memory states and past experience , 2010, Proceedings of the National Academy of Sciences.

[44]  Tom Michael Mitchell,et al.  A Neurosemantic Theory of Concrete Noun Representation Based on the Underlying Brain Codes , 2010, PloS one.

[45]  Daniel Ansari,et al.  Developmental Specialization in the Right Intraparietal Sulcus for the Abstract Representation of Numerical Magnitude , 2010, Journal of Cognitive Neuroscience.

[46]  P. Rodríguez,et al.  Neural decoding of goal locations in spatial navigation in humans with fMRI , 2009, Human brain mapping.

[47]  Bert Reynvoet,et al.  The Magnitude Representation of Small and Large Symbolic Numbers in the Left and Right Hemisphere: An Event-related fMRI Study , 2010, Journal of Cognitive Neuroscience.

[48]  J. Haynes Brain Reading: Decoding Mental States From Brain Activity In Humans , 2011 .

[49]  Marcel Adam Just,et al.  Exploring commonalities across participants in the neural representation of objects , 2012, Human brain mapping.

[50]  Shawn Betts,et al.  Tracking children's mental states while solving algebra equations , 2012, Human brain mapping.