Early Numerosity Encoding in Visual Cortex Is Not Sufficient for the Representation of Numerical Magnitude

Recent studies have demonstrated that the numerosity of visually presented dot arrays is represented in low-level visual cortex extremely early in latency. However, whether or not such an early neural signature reflects the perceptual representation of numerosity remains unknown. Alternatively, such a signature may indicate the raw sensory representation of the dot-array stimulus before becoming the perceived representation of numerosity. Here, we addressed this question by using the connectedness illusion, whereby arrays with pairwise connected dots are perceived to be less numerous compared with arrays containing isolated dots. Using EEG and fMRI in two independent experiments, we measured neural responses to dot-array stimuli comprising 16 or 32 dots, either isolated or pairwise connected. The effect of connectedness, which reflects the segmentation of the visual stimulus into perceptual units, was observed in the neural activity after 150 msec post stimulus onset in the EEG experiment and in area V3 in the fMRI experiment using a multivariate pattern analysis. In contrast, earlier neural activity before 100 msec and in area V2 was strictly modulated by numerosity regardless of connectedness, suggesting that this early activity reflects the sensory representation of a dot array before perceptual segmentation. Our findings thus demonstrate that the neural representation for numerosity in early visual cortex is not sufficient for visual number perception and suggest that the perceptual encoding of numerosity occurs at or after the segmentation process that takes place later in area V3.

[1]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[2]  Timothy Edward John Behrens,et al.  Response-Selection-Related Parietal Activation during Number Comparison , 2004, Journal of Cognitive Neuroscience.

[3]  M. Posner,et al.  Brain mechanisms of quantity are similar in 5-year-old children and adults. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Marco Dadda,et al.  Do fish count? Spontaneous discrimination of quantity in female mosquitofish , 2008, Animal Cognition.

[5]  S. Dehaene,et al.  A Magnitude Code Common to Numerosities and Number Symbols in Human Intraparietal Cortex , 2007, Neuron.

[6]  G. Alvarez,et al.  Number estimation relies on a set of segmented objects , 2009, Cognition.

[7]  David C. Burr,et al.  A generalized sense of number , 2014, Proceedings of the Royal Society B: Biological Sciences.

[8]  Hans Supèr,et al.  Feedback Enhances Feedforward Figure-Ground Segmentation by Changing Firing Mode , 2011, PloS one.

[9]  David C. Burr,et al.  Effects of adaptation on numerosity decoding in the human brain , 2016, NeuroImage.

[10]  Joonkoo Park,et al.  Rapid and Direct Encoding of Numerosity in the Visual Stream. , 2015, Cerebral cortex.

[11]  F. Durgin.  Texture density adaptation and visual number revisited , 2008, Current Biology.

[12]  Wim Fias,et al.  Stages of Nonsymbolic Number Processing in Occipitoparietal Cortex Disentangled by fMRI Adaptation , 2011, The Journal of Neuroscience.

[13]  Jun Zhang,et al.  Connectedness affects dot numerosity judgment: Implications for configural processing , 2009, Psychonomic bulletin & review.

[14]  Guido Marco Cicchini,et al.  Number As a Primary Perceptual Attribute: A Review , 2016, Perception.

[15]  Curren Katz,et al.  Dissociating estimation from comparison and response eliminates parietal involvement in sequential numerosity perception , 2015, NeuroImage.

[16]  Tiangang Zhou,et al.  Topology-defined units in numerosity perception , 2015, Proceedings of the National Academy of Sciences.

[17]  David C. Burr,et al.  Psychophysical evidence for the number sense , 2018, Philosophical Transactions of the Royal Society B: Biological Sciences.

[18]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[19]  S. Dehaene,et al.  The Number Sense: How the Mind Creates Mathematics. , 1998 .

[20]  H. Spekreijse,et al.  Masking Interrupts Figure-Ground Signals in V1 , 2002, Journal of Cognitive Neuroscience.

[21]  J. Bulthé,et al.  Format-dependent representations of symbolic and non-symbolic numbers in the human cortex as revealed by multi-voxel pattern analyses , 2014, NeuroImage.

[22]  D. C. Burr,et al.  Adaptation to number operates on perceived rather than physical numerosity , 2016, Cognition.

[23]  Daniel C. Hyde,et al.  All Numbers Are Not Equal: An Electrophysiological Investigation of Small and Large Number Representations , 2009, Journal of Cognitive Neuroscience.

[24]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[25]  Michele Fornaciai,et al.  Distinct Neural Signatures for Very Small and Very Large Numerosities , 2017, Front. Hum. Neurosci..

[26]  J. B. Levitt,et al.  Functional properties of neurons in macaque area V3. , 1997, Journal of neurophysiology.

[27]  A. Watson.  Probability summation over time , 1979, Vision Research.

[28]  Yves Frégnac,et al.  Cortical Correlates of Low-Level Perception: From Neural Circuits to Percepts , 2015, Neuron.

[29]  Melissa E. Libertus,et al.  Electrophysiological evidence for notation independence in numerical processing , 2007, Behavioral and Brain Functions.

[30]  Elizabeth M. Brannon,et al.  Modeling the approximate number system to quantify the contribution of visual stimulus features , 2015, Cognition.

[31]  Bertrand Thirion,et al.  Deciphering Cortical Number Coding from Human Brain Activity Patterns , 2009, Current Biology.

[32]  F. Kingdom,et al.  A common visual metric for approximate number and density , 2011, Proceedings of the National Academy of Sciences.

[33]  Steven T Piantadosi,et al.  True Numerical Cognition in the Wild , 2017, Psychological science.

[34]  Michele Fornaciai,et al.  Spatiotemporal feature integration shapes approximate numerical processing. , 2017, Journal of vision.

[35]  Eric Halgren,et al.  Cortical activation to illusory shapes as measured with magnetoencephalography , 2003, NeuroImage.

[36]  Joonkoo Park,et al.  A neural basis for the visual sense of number and its development: A steady-state visual evoked potential study in children and adults , 2017, Developmental Cognitive Neuroscience.

[37]  Johannes J. Fahrenfort,et al.  Masking Disrupts Reentrant Processing in Human Visual Cortex , 2007, Journal of Cognitive Neuroscience.

[38]  Elizabeth M. Brannon,et al.  Numerical encoding in early visual cortex , 2019, Cortex.

[39]  Giorgio Vallortigara,et al.  Number-space mapping in the newborn chick resembles humans’ mental number line , 2015, Science.

[40]  S. Palmer,et al.  Rethinking perceptual organization: The role of uniform connectedness , 1994, Psychonomic bulletin & review.

[41]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[42]  Philippe Pinel,et al.  Tuning Curves for Approximate Numerosity in the Human Intraparietal Sulcus , 2004, Neuron.

[43]  Liang Wang,et al.  Probabilistic Maps of Visual Topography in Human Cortex. , 2015, Cerebral cortex.

[44]  Guido Marco Cicchini,et al.  Spontaneous perception of numerosity in humans , 2016, Nature Communications.

[45]  B. P. Klein,et al.  Topographic Representation of Numerosity in the Human Parietal Cortex , 2013, Science.

[46]  Ethan Meyers,et al.  The neural decoding toolbox , 2013, Front. Neuroinform..

[47]  Michael A. Pitts,et al.  Isolating neural correlates of conscious perception from neural correlates of reporting one's perception , 2014, Front. Psychol..

[48]  Pooja Viswanathan,et al.  Neuronal correlates of a visual “sense of number” in primate parietal and prefrontal cortices , 2013, Proceedings of the National Academy of Sciences.

[49]  Susan G. Wardle,et al.  Decoding Dynamic Brain Patterns from Evoked Responses: A Tutorial on Multivariate Pattern Analysis Applied to Time Series Neuroimaging Data , 2016, Journal of Cognitive Neuroscience.

[50]  Steven J. Luck,et al.  ERPLAB: an open-source toolbox for the analysis of event-related potentials , 2014, Front. Hum. Neurosci..

[51]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[52]  Tom Verguts,et al.  Spontaneous summation or numerosity-selective coding? , 2013, Front. Hum. Neurosci..

[53]  Russell A. Poldrack,et al.  What do differences between multi-voxel and univariate analysis mean? How subject-, voxel-, and trial-level variance impact fMRI analysis , 2014, NeuroImage.

[54]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[55]  Joonkoo Park,et al.  Attractive Serial Dependence in the Absence of an Explicit Task , 2018, Psychological science.

[56]  D. Burr,et al.  A shared numerical representation for action and perception , 2016, eLife.

[57]  S. Dehaene,et al.  Characterizing the dynamics of mental representations: the temporal generalization method , 2014, Trends in Cognitive Sciences.

[58]  Irene M. Pepperberg,et al.  Cognitive and Communicative Abilities of Grey Parrots , 2002 .

[59]  R. Gregory.  The Most Expensive Painting in the World , 2007, Perception.

[60]  Elizabeth M. Brannon,et al.  Numerosity processing in early visual cortex , 2017, NeuroImage.

[61]  Henry Railo,et al.  Tracking the processes behind conscious perception: A review of event-related potential correlates of visual consciousness , 2011, Consciousness and Cognition.

[62]  C. Gallistel,et al.  Preverbal and verbal counting and computation , 1992, Cognition.

[63]  Mika Koivisto,et al.  Event-related brain potential correlates of visual awareness , 2010, Neuroscience & Biobehavioral Reviews.