Preferential Encoding of Features Distinctive for Multiple Categories

Understanding how features are encoded during category acq uisition is a fundamental challenge in the study of human learning. The current work pr oposes that in order to maintain accurate generalization in large scale categorization sys tems, features that are useful in discriminating multiple categories must be actively prefe red. This multi-class hypothesis stands in contrast with theories in which features are encoded for e ach categorization task individually, as well as theories that focus solely on encoding coincidenc es in input patterns. The current paper provides a methodology for empirically testing the propose d hypothesis under controlled conditions. It is shown that in the process of acquiring a seq uence of new categories, features that are informative for recognizing several categories are preferably encoded. Moreover, evidence is provided that after acquiring these features, representat io s of categories learned in the past are actively reconstructed by the newly encoded features. Fina lly, it is demonstrated that encoded features play a role in facilitating future category acquis ition. These results are observed using both perceptual and semantic stimuli. It is suggested that p referring features that provide maximum information on multiple categories is a general cha racteristic of the human categorization systems.

[1]  A. Tversky Features of Similarity , 1977 .

[2]  Edward E. Smith,et al.  Concepts and concept formation. , 1984, Annual review of psychology.

[3]  L. Barsalou Ideals, central tendency, and frequency of instantiation as determinants of graded structure in categories. , 1985, Journal of experimental psychology. Learning, memory, and cognition.

[4]  Paul C. Quinn,et al.  On Categorization in Early Infancy. , 1986 .

[5]  Gerald DeJong,et al.  Schema Acquisition from One Example: Psychological Evidence for Explanation-Based Learning. , 1987 .

[6]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[7]  M. Pazzani Influence of prior knowledge on concept acquisition: Experimental and computational results. , 1991 .

[8]  Linda B. Smith,et al.  The place of perception in children's concepts ☆ , 1993 .

[9]  Roberto Battiti,et al.  Using mutual information for selecting features in supervised neural net learning , 1994, IEEE Trans. Neural Networks.

[10]  P. Schyns,et al.  The Ontogeny of Part Representation in Object Concepts , 1994 .

[11]  Robert L. Goldstone Influences of categorization on perceptual discrimination. , 1994, Journal of experimental psychology. General.

[12]  Peter D. Eimas,et al.  Categorization in early infancy and the continuity of development , 1994, Cognition.

[13]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[14]  James F. Knutson,et al.  Unsupervised Concept Learning and Value Systematicity: A Complex Whole Aids Learning the Parts , 1996 .

[15]  P. Quinn,et al.  A Reexamination of the Perceptual-to-Conceptual Shift in Mental Representations , 1997 .

[16]  Jesse Spencer-Smith,et al.  The Dynamics of Similarity , 1997 .

[17]  P. Schyns,et al.  Categorization creates functional features , 1997 .

[18]  Robert L. Goldstone,et al.  The development of features in object concepts , 1998, Behavioral and Brain Sciences.

[19]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[20]  P. Schyns,et al.  Blind to Object Changes: When Learning the Same Object at Different Levels of Categorization Modifies Its Perception , 1999 .

[21]  Terrence J. Sejnowski,et al.  Unsupervised Learning , 2018, Encyclopedia of GIS.

[22]  Robert L. Goldstone Unitization during category learning. , 2000, Journal of experimental psychology. Human perception and performance.

[23]  R. Aslin,et al.  PSYCHOLOGICAL SCIENCE Research Article UNSUPERVISED STATISTICAL LEARNING OF HIGHER-ORDER SPATIAL STRUCTURES FROM VISUAL SCENES , 2022 .

[24]  S Fusi,et al.  Forming classes by stimulus frequency: Behavior and theory , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Nathan Intrator,et al.  Probabilistic principles in unsupervised learning of visual structure: human data and a model , 2001, NIPS.

[26]  N. Sigala,et al.  Visual categorization shapes feature selectivity in the primate temporal cortex , 2002, Nature.

[27]  Michel Vidal-Naquet,et al.  Visual features of intermediate complexity and their use in classification , 2002, Nature Neuroscience.

[28]  M. Behrmann,et al.  Impact of learning on representation of parts and wholes in monkey inferotemporal cortex , 2002, Nature Neuroscience.

[29]  R. Kimchi,et al.  Perceptual organization in vision : behavioral and neural perspectives , 2003 .

[30]  Nuno Vasconcelos,et al.  Scalable discriminant feature selection for image retrieval and recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[31]  F. Fleuret Fast Binary Feature Selection with Conditional Mutual Information , 2004, J. Mach. Learn. Res..

[32]  Robert L. Goldstone,et al.  PERCEPTUAL AND SEMANTIC REORGANIZATION DURING CATEGORY LEARNING , 2005 .