Do additional features help or harm during category learning? An exploration of the curse of dimensionality in human learners

How does the number of features impact category learning? One view suggests that additional features creates a “curse of dimensionality” where having more features causes the size of the search space to grow so quickly that discovering good classification rules becomes increasingly challenging. The opposing view suggests that additional features provide a wealth of additional information which learners should be able to use to improve their classification performance. Previous research exploring this issue appears to have produced conflicting results: some find that learning improves with additional features (Hoffman & Murphy, 2006) while others find that it does not (Minda & Smith, 2001; Edgell et al., 1996). Here we investigate the possibility that category structure may explain this apparent discrepancy – that more features are useful in categories with family resemblance structure, but are not (and may even be harmful) in more rule-based categories. We find while the impact of having many features does indeed depend on category structure, the results can be explained by a single unified model: one that attends to a single feature on any given trial and uses information learned from that particular feature to make classification judgments.

[1]  Joshua B. Tenenbaum,et al.  Mapping a Manifold of Perceptual Observations , 1997, NIPS.

[2]  J. Tenenbaum,et al.  Structured statistical models of inductive reasoning. , 2009, Psychological review.

[3]  Aaron B. Hoffman,et al.  Category Dimensionality and Feature Knowledge: When More Features Are Learned as Easily as Fewer Number of Dimensions in Natural and Experimental Categories , 2022 .

[4]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[5]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[6]  Joshua B. Tenenbaum,et al.  Human-level concept learning through probabilistic program induction , 2015, Science.

[7]  R. Nosofsky Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[8]  R. Roe,et al.  IRRELEVANT INFORMATION IN PROBABILISTIC CATEGORIZATION , 1996 .

[9]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[10]  J. D. Smith,et al.  Prototypes in category learning: the effects of category size, category structure, and stimulus complexity. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[11]  Jeffrey N. Rouder,et al.  Computation of Bayes Factors for Common Designs , 2015 .

[12]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[13]  R. Shepard,et al.  Learning and memorization of classifications. , 1961 .