Human Category Learning: Toward a Broader Explanatory Account

Abstract This chapter describes and integrates a set of theoretical and empirical contributions to the psychology of human category learning. A synthesis of computational and behavioral approaches is brought to bear to advance a similarity-based account that rejects the stimulus generalization underpinnings of the reference point view (such as exemplar models) and extends its explanatory scope beyond the circumscribed traditional artificial classification learning (TACL) paradigm. The framework advanced in this chapter emphasizes the role of generative (as opposed to discriminative) category learning and takes its focus in the form of the DIVA model based on a neural network architecture called the divergent autoencoder. Directions and advances that extend beyond TACL include: modes of category learning, item presentation conditions, types of categories, and measures of category representation.

[1]  D. Gentner Structure‐Mapping: A Theoretical Framework for Analogy* , 1983 .

[2]  KENNETH J. KURTZ,et al.  Re-representation in comparison: building an empirical case , 2005, J. Exp. Theor. Artif. Intell..

[3]  Tyler Davis,et al.  Memory for Category Information Is Idealized Through Contrast With Competing Options , 2010, Psychological science.

[4]  Kenneth J. Kurtz,et al.  Now you know it, now you don't: Asking the right question about category knowledge , 2014, CogSci.

[5]  R. Nosofsky,et al.  Comparing modes of rule-based classification learning: A replication and extension of Shepard, Hovland, and Jenkins (1961) , 1994, Memory & cognition.

[6]  Kimery R. Levering,et al.  Journal of Experimental Psychology: Learning, Memory, and Cognition , 2012 .

[7]  Brian H. Ross,et al.  Classification versus inference learning contrasted with real-world categories , 2011, Memory & cognition.

[8]  Brian H. Ross,et al.  Learning categories by making predictions: An investigation of indirect category learning , 2004, Memory & cognition.

[9]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[10]  D. Medin,et al.  Tall is typical: Central tendency, ideal dimensions, and graded category structure among tree experts and novices , 2000, Memory & cognition.

[11]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[12]  K. Kurtz The divergent autoencoder (DIVA) model of category learning , 2007 .

[13]  Rich Caruana,et al.  Learning Many Related Tasks at the Same Time with Backpropagation , 1994, NIPS.

[14]  Daniel Corral,et al.  The effects of relational structure on analogical learning , 2014, Cognition.

[15]  Robert L. Goldstone The role of similarity in categorization: providing a groundwork , 1994, Cognition.

[16]  G. Bower,et al.  From conditioning to category learning: an adaptive network model. , 1988 .

[17]  Eric G Taylor,et al.  Classifying partial exemplars: seeing less and learning more. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[18]  L. Barsalou Ideals, central tendency, and frequency of instantiation as determinants of graded structure in categories. , 1985, Journal of experimental psychology. Learning, memory, and cognition.

[19]  Michael I. Jordan,et al.  On Discriminative vs. Generative Classifiers: A comparison of logistic regression and naive Bayes , 2001, NIPS.

[20]  D. Medin,et al.  The native mind: biological categorization and reasoning in development and across cultures. , 2004, Psychological review.

[21]  H. Roediger Cognitive psychology of memory , 2008 .

[22]  D. Gentner,et al.  Metaphor and knowledge change , 2000 .

[23]  Lewis Bott,et al.  Blocking in category learning. , 2007, Journal of experimental psychology. General.

[24]  D. Medin,et al.  The role of theories in conceptual coherence. , 1985, Psychological review.

[25]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[26]  D. Gentner,et al.  Structural Alignment during Similarity Comparisons , 1993, Cognitive Psychology.

[27]  B. Ross,et al.  Category vs. Object Knowledge in Category-based Induction. , 2010, Journal of memory and language.

[28]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[29]  R. Shepard,et al.  Learning and memorization of classifications. , 1961 .

[30]  Gregory L. Murphy The study of concepts inside and outside of the laboratory: Medin verus Medin , 2005 .

[31]  Dedre Gentner,et al.  Mechanisms of Analogical Learning. , 1987 .

[32]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[33]  Dedre Gentner,et al.  Learning by Analogical Bootstrapping , 2001 .

[34]  T. Ben-David,et al.  Exploiting Task Relatedness for Multiple , 2003 .

[35]  Dedre Gentner,et al.  Relations, Objects, and the Composition of Analogies , 2006, Cogn. Sci..

[36]  David L. Faigman,et al.  Human category learning. , 2005, Annual review of psychology.

[37]  Dedre Gentner,et al.  Detecting anomalous features in complex stimuli: the role of structured comparison. , 2013, Journal of experimental psychology. Applied.

[38]  A. Markman,et al.  Category use and category learning. , 2003, Psychological bulletin.

[39]  Daniel F. Chambliss,et al.  Evolution of conceptual structure , 1979 .

[40]  Dedre Gentner,et al.  Why we’re so smart , 2003 .

[41]  Nathalie Japkowicz,et al.  Supervised Versus Unsupervised Binary-Learning by Feedforward Neural Networks , 2004, Machine Learning.

[42]  David E. Rumelhart,et al.  Toward a microstructural account of human reasoning , 1989 .

[43]  Paul D. Allopenna,et al.  The locus of knowledge effects in concept learning. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[44]  Brian Ross,et al.  Comparisons in Category Learning: How Best to Compare For What , 2011, CogSci.

[45]  A. Markman,et al.  Category Learning by Inference and Classification , 1998 .

[46]  Aaron B. Hoffman,et al.  Category Dimensionality and Feature Knowledge: When More Features Are Learned as Easily as Fewer Number of Dimensions in Natural and Experimental Categories , 2022 .

[47]  I. Jolliffe Principal Component Analysis , 2002 .

[48]  R. Nosofsky,et al.  Rule-plus-exception model of classification learning. , 1994, Psychological review.

[49]  Kimery R. Levering,et al.  The Influence of Learning to Distinguish Categories on Graded Structure , 2006 .

[50]  Douglas L. Medin,et al.  The Native Mind : Biological Categorization , Reasoning , and Decision Making in Development and Across Cultures , 2002 .

[51]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[52]  Emmanuel M. Pothos,et al.  Formal Approaches in Categorization: Contents , 2011 .

[53]  Nathan Intratoryx,et al.  Learning low-dimensional representations via the usage of multiple-class labels , 1997 .

[54]  D. Medin,et al.  Concepts do more than categorize , 1999, Trends in Cognitive Sciences.

[55]  Mark D. Plumbley,et al.  Unsupervised neural network learning procedures for feature extraction and classification , 1996, Applied Intelligence.

[56]  A. Markman,et al.  Inference using categories. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[57]  Kenneth J. Kurtz,et al.  Category learning in the context of co-presented items , 2011, Cognitive Processing.

[58]  Bob Rehder,et al.  Feature inference learning and eyetracking , 2009 .

[59]  Robert Rehder,et al.  Causal-based classification: A review , 2010 .

[60]  Robert L. Goldstone,et al.  Altering object representations through category learning , 2001, Cognition.

[61]  Bradley C. Love,et al.  When learning to classify by relations is easier than by features , 2010 .

[62]  James L. McClelland,et al.  A distributed model of human learning and memory , 1986 .

[63]  Benjamin D. Jee,et al.  Learning about the Internal Structure of Categories through Classification and Feature Inference , 2014, Quarterly journal of experimental psychology.

[64]  V. Sloutsky,et al.  What's behind different kinds of kinds: effects of statistical density on learning and representation of categories. , 2008, Journal of experimental psychology. General.

[65]  Arthur B. Markman,et al.  Role-governed categories , 2001, J. Exp. Theor. Artif. Intell..

[66]  Gregory L. Murphy,et al.  Ecological Validity and the Study of Concepts , 2003 .

[67]  Naomi Sweller,et al.  More than one kind of inference: Re-examining what's learned in feature inference and classification , 2010, Quarterly journal of experimental psychology.

[68]  J. D. Smith,et al.  Prototypes in category learning: the effects of category size, category structure, and stimulus complexity. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[69]  Seth Chin-Parker,et al.  A further investigation of category learning by inference , 2002, Memory & cognition.

[70]  J. Kruschke,et al.  Rules and exemplars in category learning. , 1998, Journal of experimental psychology. General.

[71]  B. Love,et al.  Putting the psychology back into psychological models: Mechanistic versus rational approaches , 2008, Memory & cognition.

[72]  B. Ross,et al.  Concept and Category Learning in Humans , 2008 .

[73]  Mark A. Gluck,et al.  Component and pattern information in adaptive networks , 1990 .

[74]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[75]  B. Ross,et al.  Comparison-based learning: effects of comparing instances during category learning. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[76]  John K. Kruschke,et al.  Human Category Learning: Implications for Backpropagation Models , 1993 .

[77]  E. Pothos,et al.  The fickle nature of similarity change as a result of categorization , 2014, Quarterly journal of experimental psychology.

[78]  Aaron B. Hoffman,et al.  The costs of supervised classification: The effect of learning task on conceptual flexibility. , 2010, Journal of experimental psychology. General.

[79]  B. Ross,et al.  Abstract coherent categories. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[80]  Kenneth R. Livingston,et al.  Categorical Perception Effects Induced by Category Learning , 1998 .

[81]  S. Lewandowsky,et al.  Knowledge partitioning in categorization: constraints on exemplar models. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[82]  John F. Kolen,et al.  Backpropagation is Sensitive to Initial Conditions , 1990, Complex Syst..

[83]  W. R. Garner The Processing of Information and Structure , 1974 .

[84]  R. Shepard Stimulus and response generalization: A stochastic model relating generalization to distance in psychological space , 1957 .

[85]  G. Murphy,et al.  The Big Book of Concepts , 2002 .

[86]  S. Edelman,et al.  Learning low-dimensional representations via the usage of multiple-class labels , 1997 .

[87]  Gerrit Storms,et al.  Prototype and Exemplar-Based Information in Natural Language Categories , 2000 .

[88]  Robert L. Goldstone,et al.  Concepts and Categorization , 2003 .

[89]  Dedre Gentner,et al.  Systematicity as a Selection Constraint in Analogical Mapping , 1991, Cogn. Sci..

[90]  Micah B. Goldwater,et al.  The empirical case for role-governed categories , 2011, Cognition.

[91]  R. Nosofsky Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[92]  Seth Chin-Parker,et al.  Diagnosticity and prototypicality in category learning: a comparison of inference learning and classification learning. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[93]  D. Homa,et al.  Expanding the search for a linear separability constraint on category learning , 2001, Memory & cognition.

[94]  D. Gentner,et al.  Similarity and the development of rules , 1998, Cognition.

[95]  D. Gentner,et al.  Comparison promotes learning and transfer of relational categories. , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[96]  E. Wisniewski,et al.  Prior knowledge and functionally relevant features in concept learning. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[97]  M. Posner,et al.  On the genesis of abstract ideas. , 1968, Journal of experimental psychology.

[98]  B. Ross,et al.  Predictions From Uncertain Categorizations , 1994, Cognitive Psychology.

[99]  A. Wills,et al.  On the adequacy of current empirical evaluations of formal models of categorization. , 2012, Psychological bulletin.

[100]  Robert L. Goldstone,et al.  The development of features in object concepts , 1998, Behavioral and Brain Sciences.

[101]  Stephen A. Ritz,et al.  Distinctive features, categorical perception, and probability learning: some applications of a neural model , 1977 .

[102]  John R. Anderson,et al.  The Adaptive Nature of Human Categorization. , 1991 .

[103]  Erkki Oja,et al.  Subspace methods of pattern recognition , 1983 .

[104]  D. Luce,et al.  Detection and Recognition " ' , 2006 .

[105]  Corey J Bohil,et al.  Observational versus feedback training in rule-based and information-integration category learning , 2002, Memory & cognition.

[106]  D. Gentner,et al.  Comparison and Categorization in the Development of Relational Similarity , 1996 .

[107]  D. Medin,et al.  SUSTAIN: a network model of category learning. , 2004, Psychological review.

[108]  John K Kruschke,et al.  Category representation for classification and feature inference. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[109]  Kimery R. Levering,et al.  Observation versus classification in supervised category learning , 2015, Memory & cognition.

[110]  Yasuaki Sakamoto,et al.  Learning and retention through predictive inference and classification. , 2010, Journal of experimental psychology. Applied.

[111]  Kurt Hornik,et al.  Neural networks and principal component analysis: Learning from examples without local minima , 1989, Neural Networks.