The Effects of Frequency, Variability, and Co-occurrence on Category Formation in Neural Systems

Abstract Objects are grouped into categories through a complex combination of statistical and structural regularities. We sought to better understand the neural responses to the structural features of object categories that result from implicit learning. Adult participants were exposed to 32 object categories that contained three structural properties: frequency, variability, and co-occurrences, during an implicit learning task. After this exposure, participants completed a recognition task and were then presented with blocks of learned object categories during fMRI sessions. Analyses were performed by extracting data from ROIs placed throughout the fusiform gyri and lateral occipital cortex and comparing the effects of the different structural properties throughout the ROIs. Behaviorally, we found that symbol category recognition was supported by frequency, but not variability. Neurally, we found that sensitivity to object categories was greater in the right hemisphere and increased as ROIs were moved posteriorly. Frequency and variability altered the brain activation while processing object categories, although the presence of learned co-occurrences did not. Moreover, variability and co-occurrence interacted as a function of ROI, with the posterior fusiform gyrus being most sensitive to this relationship. This result suggests that variability may guide the learner to relevant co-occurrences and this is supported by the posterior ventral temporal cortex. Broadly, our results suggest that the internal features of the categories themselves are key factors in the category learning system.

[1]  James M. Rehg,et al.  Real-world visual statistics and infants' first-learned object names , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[2]  K. James,et al.  Visual experiences during letter production contribute to the development of the neural systems supporting letter perception. , 2019, Developmental science.

[3]  Nancy Kanwisher,et al.  The Quest for the FFA and Where It Led , 2017, The Journal of Neuroscience.

[4]  William B Estes,et al.  Similarity , Frequency , and Category Representations , 1988 .

[5]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[6]  P. Gerhardstein,et al.  Three-month-old infants' object recognition across changes in viewpoint using an operant learning procedure. , 2006, Infant behavior & development.

[7]  Daniel J. Plebanek,et al.  Category structure guides the formation of neural representations , 2021, Experimental Brain Research.

[8]  Linda B. Smith,et al.  Infants rapidly learn word-referent mappings via cross-situational statistics , 2008, Cognition.

[9]  Marvin M. Chun,et al.  Neural Evidence of Statistical Learning: Efficient Detection of Visual Regularities Without Awareness , 2009, Journal of Cognitive Neuroscience.

[10]  F. Gregory Ashby,et al.  Chapter 25 – MULTIPLE SYSTEMS OF PERCEPTUAL CATEGORY LEARNING: THEORY AND COGNITIVE TESTS , 2005 .

[11]  Linda B. Smith,et al.  The Developing Infant Creates a Curriculum for Statistical Learning , 2018, Trends in Cognitive Sciences.

[12]  E. Rosch,et al.  Family resemblances: Studies in the internal structure of categories , 1975, Cognitive Psychology.

[13]  K. James,et al.  The role of sensorimotor learning in the perception of letter-like forms: Tracking the causes of neural specialization for letters , 2009, Cognitive neuropsychology.

[14]  Linda B. Smith,et al.  Rapid Word Learning Under Uncertainty via Cross-Situational Statistics , 2007, Psychological science.

[15]  Vladimir M. Sloutsky,et al.  From Perceptual Categories to Concepts: What Develops? , 2010, Cogn. Sci..

[16]  Kalanit Grill-Spector,et al.  Representation of shapes, edges, and surfaces across multiple cues in the human visual cortex. , 2008, Journal of neurophysiology.

[17]  K. Grill-Spector,et al.  The functional architecture of the ventral temporal cortex and its role in categorization , 2014, Nature Reviews Neuroscience.

[18]  Mariano Sigman,et al.  Hierarchical Coding of Letter Strings in the Ventral Stream: Dissecting the Inner Organization of the Visual Word-Form System , 2007, Neuron.

[19]  Hu Cheng,et al.  An Analysis of the Brain Systems Involved with Producing Letters by Hand , 2019, Journal of Cognitive Neuroscience.

[20]  Linda B. Smith,et al.  Self-generated variability in object images predicts vocabulary growth. , 2019, Developmental science.

[21]  K. James Sensori-motor experience leads to changes in visual processing in the developing brain. , 2010, Developmental science.

[22]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[23]  R N Aslin,et al.  Statistical Learning by 8-Month-Old Infants , 1996, Science.

[24]  Talma Hendler,et al.  Eccentricity Bias as an Organizing Principle for Human High-Order Object Areas , 2002, Neuron.

[25]  E. Bullmore,et al.  Methods for diagnosis and treatment of stimulus‐correlated motion in generic brain activation studies using fMRI , 1999, Human brain mapping.

[26]  K. James,et al.  Only self-generated actions create sensori-motor systems in the developing brain. , 2011, Developmental science.

[27]  Isabel Gauthier,et al.  Letter processing in the visual system: Different activation patterns for single letters and strings , 2005, Cognitive, affective & behavioral neuroscience.

[28]  R. Poldrack,et al.  Quantifying the internal structure of categories using a neural typicality measure. , 2014, Cerebral cortex.

[29]  Li Fei-Fei,et al.  Typicality sharpens category representations in object-selective cortex , 2016, NeuroImage.

[30]  G K Humphrey,et al.  Encoding ‘Regular’ and ‘Random’ Sequences of Views of Novel Three-Dimensional Objects , 1999, Perception.

[31]  Justin N. Wood A smoothness constraint on the development of object recognition , 2016, Cognition.

[32]  Linda B Smith,et al.  Some views are better than others: evidence for a visual bias in object views self-generated by toddlers. , 2014, Developmental science.

[33]  Lauren V. Kustner,et al.  Shaping of Object Representations in the Human Medial Temporal Lobe Based on Temporal Regularities , 2012, Current Biology.

[34]  Narendra Ahuja,et al.  Learning to recognize objects , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[35]  I. Gauthier,et al.  Expertise for cars and birds recruits brain areas involved in face recognition , 2000, Nature Neuroscience.

[36]  N. Kanwisher,et al.  The fusiform face area subserves face perception, not generic within-category identification , 2004, Nature Neuroscience.

[37]  Karin H. James,et al.  The Importance of Handwriting Experience on the Development of the Literate Brain , 2017 .

[38]  Brynn E. Sherman,et al.  The prevalence and importance of statistical learning in human cognition and behavior , 2020, Current Opinion in Behavioral Sciences.

[39]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[40]  K. James,et al.  The effects of handwriting experience on functional brain development in pre-literate children , 2012, Trends in Neuroscience and Education.

[41]  K. James,et al.  Visual experiences during letter production contribute to the development of the neural systems supporting letter perception. , 2020, Developmental science.

[42]  K. James,et al.  Handwriting generates variable visual output to facilitate symbol learning. , 2016, Journal of experimental psychology. General.

[43]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[44]  V. Sloutsky,et al.  What's behind different kinds of kinds: effects of statistical density on learning and representation of categories. , 2008, Journal of experimental psychology. General.

[45]  Lawrence L. Wald,et al.  Accurate prediction of V1 location from cortical folds in a surface coordinate system , 2008, NeuroImage.

[46]  J. Talairach,et al.  Co-Planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System: An Approach to Cerebral Imaging , 1988 .

[47]  Jack L. Gallant,et al.  Natural Scene Statistics Account for the Representation of Scene Categories in Human Visual Cortex , 2013, Neuron.