The Influences of Category Learning on Perceptual Reconstructions

We explore different ways in which the human visual system can adapt for perceiving and categorizing the environment. There are various accounts of supervised (categorical) and unsupervised perceptual learning, and different perspectives on the functional relationship between perception and categorization. We suggest that common experimental designs are insufficient to differentiate between hypothesized perceptual learning mechanisms and reveal their possible interplay. We propose a relatively underutilized way of studying potential categorical effects on perception, and we test the predictions of different perceptual learning models using a two-dimensional, interleaved categorization-plus-reconstruction task. We find evidence that the human visual system adapts its encodings to the feature structure of the environment, uses categorical expectations for robust reconstruction, allocates encoding resources with respect to categorization utility, and adapts to prevent miscategorizations.

[1]  A. Clark,et al.  Effects of Language on Visual Perception , 2020, Trends in Cognitive Sciences.

[2]  Christopher J Bates,et al.  Efficient data compression in perception and perceptual memory. , 2020, Psychological review.

[3]  Christopher J Bates,et al.  Adaptive allocation of human visual working memory capacity during statistical and categorical learning. , 2019, Journal of vision.

[4]  Robert Jacobs,et al.  Efficient Data Compression Leads to Categorical Bias in Perception and Perceptual Memory , 2019, CogSci.

[5]  Chris R Sims,et al.  Efficient coding explains the universal law of generalization in human perception , 2018, Science.

[6]  Benjamin M. Chin,et al.  The Effects of Categorization on Perceptual Judgment are Robust across Different Assessment Tasks , 2016 .

[7]  Yang Xu,et al.  The Sapir-Whorf Hypothesis and Probabilistic Inference: Evidence from the Domain of Color , 2016, CogSci.

[8]  C. Sims Rate–distortion theory and human perception , 2016, Cognition.

[9]  A. Clark,et al.  Words and the World , 2015 .

[10]  B. Scholl,et al.  Cognition does not affect perception: Evaluating the evidence for “top-down” effects , 2015, Behavioral and Brain Sciences.

[11]  Gary Lupyan,et al.  Cognitive Penetrability of Perception in the Age of Prediction: Predictive Systems are Penetrable Systems , 2015 .

[12]  Robert C. Wilson,et al.  Reinforcement Learning in Multidimensional Environments Relies on Attention Mechanisms , 2015, The Journal of Neuroscience.

[13]  S. Siegel,et al.  Cognitive Penetrability of Perception in the Age of Prediction: Predictive Systems are Penetrable Systems , 2015 .

[14]  Chaz Firestone,et al.  " Top-down " Effects Where None Should Be Found: the El Greco Fallacy in Perception Research , 2022 .

[15]  B. Scholl,et al.  'Top-down' effects where none should be found: The El Greco fallacy in perception research , 2013 .

[16]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[17]  Jonathan R. Folstein,et al.  Category learning increases discriminability of relevant object dimensions in visual cortex. , 2013, Cerebral cortex.

[18]  L. Hedges,et al.  Category effects on stimulus estimation: Shifting and skewed frequency distributions , 2010, Psychonomic bulletin & review.

[19]  Y. Niv,et al.  Learning latent structure: carving nature at its joints , 2010, Current Opinion in Neurobiology.

[20]  Robert L. Goldstone,et al.  Categorical perception. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[21]  Naomi H. Feldman,et al.  The influence of categories on perception: explaining the perceptual magnet effect as optimal statistical inference. , 2009, Psychological review.

[22]  Karl J. Friston,et al.  Predictive coding under the free-energy principle , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[23]  Robert L. Goldstone,et al.  The effect of the internal structure of categories on perception , 2008 .

[24]  Konrad Paul Kording,et al.  Decision Theory: What "Should" the Nervous System Do? , 2007, Science.

[25]  D. Roberson,et al.  Categorical perception of facial expressions: Evidence for a “category adjustment” model , 2007, Memory & cognition.

[26]  Michael C. Frank,et al.  Russian blues reveal effects of language on color discrimination , 2007, Proceedings of the National Academy of Sciences.

[27]  J. Davidoff,et al.  Color categories: Evidence for the cultural relativity hypothesis , 2005, Cognitive Psychology.

[28]  Paul T. Sowden,et al.  The nature of learned categorical perception effects: a psychophysical approach , 2005, Cognition.

[29]  Mark R. Blair,et al.  Differentiation for Novel Dimensions , 2005 .

[30]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[31]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[32]  Robert L. Goldstone Learning to Perceive While Perceiving to Learn , 2003 .

[33]  Wilson S. Geisler,et al.  A Bayesian approach to the evolution of perceptual and cognitive systems , 2003, Cogn. Sci..

[34]  Y. Tohkura,et al.  A perceptual interference account of acquisition difficulties for non-native phonemes , 2003, Cognition.

[35]  Johan Wagemans,et al.  The effect of category learning on the representation of shape: dimensions can be biased but not differentiated. , 2003, Journal of experimental psychology. General.

[36]  W. Geisler Ideal Observer Analysis , 2002 .

[37]  K. Clark CONDITIONS FOR VERSATILE LEARNING , HELMHOLTZ ’ S UNCONSCIOUS INFERENCE , AND THE TASK OF PERCEPTION , 2002 .

[38]  Robert L. Goldstone,et al.  The sensitization and differentiation of dimensions during category learning. , 2001, Journal of experimental psychology. General.

[39]  J. Davidoff,et al.  Color categories are not universal: replications and new evidence from a stone-age culture. , 2000, Journal of experimental psychology. General.

[40]  Jack L. Vevea,et al.  Why do categories affect stimulus judgment? , 2000, Journal of experimental psychology. General.

[41]  D. Levin,et al.  Categorical perception occurs in newly learned faces, other-race faces, and inverted faces , 2000, Perception & psychophysics.

[42]  Kenneth R. Livingston,et al.  Categorical Perception Effects Induced by Category Learning , 1998 .

[43]  David C. Knill,et al.  Introduction: a Bayesian formulation of visual perception , 1996 .

[44]  F. Keil,et al.  Categorical effects in the perception of faces , 1995, Cognition.

[45]  Robert L. Goldstone Effects of Categorization on Color Perception , 1995 .

[46]  S. Hanson,et al.  Learned Categorical Perception in Neural Nets: Implications for Symbol Grounding , 1995 .

[47]  P. Kuhl Learning and representation in speech and language , 1994, Current Opinion in Neurobiology.

[48]  Robert L. Goldstone Influences of categorization on perceptual discrimination. , 1994, Journal of experimental psychology. General.

[49]  John J. Magee,et al.  Categorical perception of facial expressions , 1992, Cognition.

[50]  P. Kuhl Human adults and human infants show a “perceptual magnet effect” for the prototypes of speech categories, monkeys do not , 1991, Perception & psychophysics.

[51]  Stevan Harnad,et al.  Categorical Perception and the Evolution of Supervised Learning in Neural Nets , 1991 .

[52]  Jerome R. Busemeyer,et al.  A New Method for Investigating Prototype Learning , 1988 .

[53]  R. Weale Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[54]  P. Kay,et al.  What is the Sapir-Whorf hypothesis? , 1983 .

[55]  E. Gibson Principles of Perceptual Learning and Development , 1969 .

[56]  B. C. Griffith,et al.  The discrimination of speech sounds within and across phoneme boundaries. , 1957, Journal of experimental psychology.

[57]  J. Gibson,et al.  Perceptual learning; differentiation or enrichment? , 1955, Psychological review.

[58]  D. Lawrence Acquired distinctiveness of cues; transfer between discrimination on the basis of familiarity with the stimulus. , 1949, Journal of experimental psychology.