A Rational Analysis of Rule-Based Concept Learning

This article proposes a new model of human concept learning that provides a rational analysis of learning feature-based concepts. This model is built upon Bayesian inference for a grammatically structured hypothesis space-a concept language of logical rules. This article compares the model predictions to human generalization judgments in several well-known category learning experiments, and finds good agreement for both average and individual participant generalizations. This article further investigates judgments for a broad set of 7-feature concepts-a more natural setting in several ways-and again finds that the model explains human performance.

[1]  E. Cassirer,et al.  Language and Myth , 1947 .

[2]  E. Cassirer,et al.  Language and Myth , 1948 .

[3]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[4]  N. Goodman.  Fact, Fiction, and Forecast , 1955 .

[5]  William M. Smith,et al.  A Study of Thinking , 1956 .

[6]  L. Wittgenstein.  Philosophical investigations = Philosophische Untersuchungen , 1958 .

[7]  R. Duncan Luce,et al.  Individual Choice Behavior , 1959 .

[8]  R. Shepard,et al.  Learning and memorization of classifications. , 1961 .

[9]  R. Shepard,et al.  Stimulus generalization in the learning of classifications. , 1963, Journal of experimental psychology.

[10]  M. Posner,et al.  On the genesis of abstract ideas. , 1968, Journal of experimental psychology.

[11]  Stephen K. Reed,et al.  Pattern recognition and categorization , 1972 .

[12]  Herbert B. Enderton,et al.  A mathematical introduction to logic , 1972 .

[13]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[14]  Edward E. Smith,et al.  On the adequacy of prototype theory as a theory of concepts , 1981, Cognition.

[15]  G. Miller,et al.  Cognitive science. , 1981, Science.

[16]  D. Medin,et al.  Linear separability in classification learning. , 1981 .

[17]  E. Rosch,et al.  Categorization of Natural Objects , 1981 .

[18]  Edward E. Smith,et al.  Categories and concepts , 1984 .

[19]  Mark W. Altom,et al.  Correlated symptoms and simulated medical classification. , 1982, Journal of experimental psychology. Learning, memory, and cognition.

[20]  Sharon Lee Armstrong,et al.  What some concepts might not be , 1983, Cognition.

[21]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[22]  R. Nosofsky.  Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[23]  R. Shepard,et al.  Toward a universal law of generalization for psychological science. , 1987, Science.

[24]  D. Medin,et al.  Family resemblance, conceptual cohesiveness, and category construction , 1987, Cognitive Psychology.

[25]  D M Ennis,et al.  Toward a universal law of generalization. , 1988, Science.

[26]  G. Lakoff,et al.  Women, Fire, and Dangerous Things: What Categories Reveal about the Mind , 1988 .

[27]  R. Nosofsky.  Further tests of an exemplar-similarity approach to relating identification and categorization , 1989, Perception & psychophysics.

[28]  G. Lakoff.  Women, fire, and dangerous things : what categories reveal about the mind , 1989 .

[29]  R. Nosofsky,et al.  Rules and exemplars in categorization, identification, and recognition. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[30]  R. Jakobson.  On Language , 1990 .

[31]  John R. Anderson,et al.  The Adaptive Nature of Human Categorization. , 1991 .

[32]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[33]  W T Maddox,et al.  Comparing decision bound and exemplar models of categorization , 1993, Perception & psychophysics.

[34]  John K. Kruschke,et al.  Human Category Learning: Implications for Backpropagation Models , 1993 .

[35]  John R. Anderson,et al.  The Adaptive Character of Thought , 1990 .

[36]  R. Nosofsky,et al.  Rule-plus-exception model of classification learning. , 1994, Psychological review.

[37]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[38]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[39]  Robert L. Goldstone.  Isolated and interrelated concepts , 1996, Memory & cognition.

[40]  R. Nosofsky,et al.  Learning to classify integral-dimension stimuli , 1996, Psychonomic bulletin & review.

[41]  S. Sloman.  The empirical case for two systems of reasoning. , 1996 .

[42]  P. Schyns,et al.  Categorization creates functional features , 1997 .

[43]  N. Chater,et al.  An introduction to rational models of cognition , 1998 .

[44]  Joshua B. Tenenbaum,et al.  Bayesian Modeling of Human Concept Learning , 1998, NIPS.

[45]  S. Sloman,et al.  Similarity as an explanatory construct , 1998, Cognition.

[46]  J. Fodor,et al.  Concepts: Where Cognitive Science Went Wrong , 1998 .

[47]  R. Nosofsky,et al.  A rule-plus-exception model for classifying objects in continuous-dimension spaces , 1998 .

[48]  Steven A. Sloman,et al.  Feature Centrality and Conceptual Coherence , 1998, Cogn. Sci..

[49]  J. Kruschke,et al.  Rules and exemplars in category learning. , 1998, Journal of experimental psychology. General.

[50]  Robert L. Goldstone,et al.  The development of features in object concepts , 1998, Behavioral and Brain Sciences.

[51]  J. D. Smith,et al.  Prototypes in the Mist: The Early Epochs of Category Learning , 1998 .

[52]  N. Chater,et al.  Ten years of the rational analysis of cognition , 1999, Trends in Cognitive Sciences.

[53]  Joshua B. Tenenbaum,et al.  Rules and Similarity in Concept Learning , 1999, NIPS.

[54]  S. Pinker.  How the Mind Works , 1999, Annals of the New York Academy of Sciences.

[55]  Peter Sollich,et al.  Advances in neural information processing systems 11 , 1999 .

[56]  J. Tenenbaum.  A Bayesian framework for concept learning , 1999 .

[57]  R. Ratcliff,et al.  Connectionist and diffusion models of reaction time. , 1999, Psychological review.

[58]  Jacob Feldman,et al.  Minimization of Boolean complexity in human concept learning , 2000, Nature.

[59]  N. Chater,et al.  Rational models of cognition , 1998 .

[60]  K. Lamberts.  Information-accumulation theory of speeded categorization. , 2000, Psychological review.

[61]  Arthur B. Markman,et al.  Role-governed categories , 2001, J. Exp. Theor. Artif. Intell..

[62]  Jacob feldman,et al.  Bayesian contour integration , 2001, Perception & psychophysics.

[63]  Refractor.  Vision , 2000, The Lancet.

[64]  J. Tenenbaum,et al.  Generalization, similarity, and Bayesian inference. , 2001, The Behavioral and brain sciences.

[65]  Mark K. Johansen,et al.  Are there representational shifts during category learning? , 2002, Cognitive Psychology.

[66]  N. Chopin.  A sequential particle filter method for static models , 2002 .

[67]  G. Murphy,et al.  The Big Book of Concepts , 2002 .

[68]  W. Geisler.  Ideal Observer Analysis , 2002 .

[69]  B. Love.  Comparing supervised and unsupervised category learning , 2002, Psychonomic bulletin & review.

[70]  B. Rehder.  A causal-model theory of conceptual representation and categorization. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[71]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[72]  Peter Norvig,et al.  Artificial intelligence - a modern approach, 2nd Edition , 2003, Prentice Hall series in artificial intelligence.

[73]  J. Feldman.  The Simplicity Principle in Human Concept Learning , 2003 .

[74]  P. Kantor.  Foundations of Statistical Natural Language Processing , 2001, Information Retrieval.

[75]  J. Feldman.  How surprising is a simple pattern? Quantifying “Eureka!” , 2004, Cognition.

[76]  J. D. Smith,et al.  Category learning in rhesus monkeys: a study of the Shepard, Hovland, and Jenkins (1961) tasks. , 2004, Journal of experimental psychology. General.

[77]  R. Baierlein.  Probability Theory: The Logic of Science , 2004 .

[78]  D. Medin,et al.  SUSTAIN: a network model of category learning. , 2004, Psychological review.

[79]  Fei Xu,et al.  Word Learning as Bayesian Inference: Evidence from Preschoolers , 2005 .

[80]  J. Tenenbaum,et al.  Structure and strength in causal induction , 2005, Cognitive Psychology.

[81]  E. Pothos.  The rules versus similarity distinction. , 2005, The Behavioral and brain sciences.

[82]  Joseph Y. Halpern,et al.  Causes and Explanations: A Structural-Model Approach. Part II: Explanations , 2001, The British Journal for the Philosophy of Science.

[83]  A. Markman,et al.  Categorization inside and outside the laboratory : essays in honor of Douglas L. Medin , 2005 .

[84]  J. Kruschke.  Locally Bayesian learning with applications to retrospective revaluation and highlighting. , 2006, Psychological review.

[85]  Thomas L. Griffiths,et al.  A more rational model of categorization , 2006 .

[86]  J. Feldman.  An algebra of human concept learning , 2006 .

[87]  Daniel J. Navarro,et al.  From natural kinds to complex categories , 2006 .

[88]  J. Tenenbaum,et al.  Word learning as Bayesian inference. , 2007, Psychological review.

[89]  Thomas L. Griffiths,et al.  Compositionality in rational analysis: grammar-based induction for concept learning , 2008 .