On the Interaction of Theory and Data in Concept Learning

Standard models of concept learning generally focus on deriving statistical properties of a category based on data (i.e., category members and the features that describe them) but fail to give appropriate weight to the contact between people's intuitive theories and these data. Two experiments explored the role of people's prior knowledge or intuitive theories on category learning by manipulating the labels associated with the category. Learning differed dramatically when categories of children's drawings were meaningfully labeled (e.g., “done by creative children”) compared to when they were labeled in a neutral manner. When categories are meaningfully labeled, people bring intuitive theories to the learning context. Learning then involves a process in which people search for evidence in the data that supports abstract features or hypotheses that have been activated by the intuitive theories. In contrast, when categories are labeled in a neutral manner, people search for simple features that distinguish one category from another. Importantly, the final study suggests that learning involves an interaction of people's intuitive theories with data, in which theories and data mutually influence each other. The results strongly suggest that straight-forward, relatively modular ways of incorporating prior knowledge into models of category learning are inadequate. More telling, the results suggest that standard models may have fundamental limitations. We outline a speculative model of learning in which the interaction of theory and data is tightly coupled. The article concludes by comparing the results to recent artificial intelligence systems that use prior knowledge during learning.

[1]  Scott Bennett,et al.  A Domain Independent Explanation-Based Generalizer , 1986, AAAI.

[2]  Douglas L. Hintzman,et al.  "Schema Abstraction" in a Multiple-Trace Memory Model , 1986 .

[3]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[4]  Gregory L. Murphy,et al.  Feature correlations in conceptual representations , 1989 .

[5]  Michael Lebowitz,et al.  Integrated Learning: Controlling Explanation , 1986, Cogn. Sci..

[6]  Douglas L. Medin,et al.  Harpoons and long sticks: the interaction of theory and similarity in rule induction , 1991 .

[7]  U. Neisser Concepts and Conceptual Development: Ecological and Intellectual Factors in Categorization , 1989 .

[8]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[9]  Giulia Pagallo,et al.  Learning DNF by Decision Trees , 1989, IJCAI.

[10]  Dedre Gentner,et al.  Mechanisms of Analogical Learning. , 1987 .

[11]  D. Medin,et al.  The role of theories in conceptual coherence. , 1985, Psychological review.

[12]  F. Goodenough,et al.  Studies in the psychology of children's drawings , 1950 .

[13]  M. Pazzani Influence of prior knowledge on concept acquisition: Experimental and computational results. , 1991 .

[14]  L. Rips Similarity, typicality, and categorization , 1989 .

[15]  Raymond J. Mooney,et al.  Induction Over the Unexplained: Integrated Learning of Concepts with Both Explainable and Conventional Aspects , 1989, ML.

[16]  W. Estes,et al.  Base-rate effects in category learning: a comparison of parallel network and memory storage-retrieval models. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[17]  Thomas Ellman,et al.  Explanation-based learning: a survey of programs and perspectives , 1989, CSUR.

[18]  R. Nosofsky Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[19]  Richard S. Sutton,et al.  Learning Polynomial Functions by Feature Construction , 1991, ML.

[20]  Ryszard S. Michalski,et al.  Constraints and Preferences in Inductive Learning: An Experimental Study of Human and Machine Performance , 1987, Cogn. Sci..

[21]  Woo-Kyoung Ahn,et al.  A Two-Stage Model of Category Construction , 1992, Cogn. Sci..

[22]  B. R. Bugelski,et al.  The role of frequency in developing perceptual sets. , 1961, Canadian journal of psychology.

[23]  S. Carey,et al.  On differentiation: A case study of the development of the concepts of size, weight, and density , 1985, Cognition.

[24]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[25]  Douglas L. Medin,et al.  The fiction and nonfiction of features: Volume IV , 1994 .

[26]  S. Carey Conceptual Change in Childhood , 1985 .

[27]  D. Gentner,et al.  Splitting the Differences: A Structural Alignment View of Similarity , 1993 .

[28]  D. Medin,et al.  Context and structure in conceptual combination , 1988, Cognitive Psychology.

[29]  John R. Anderson The Adaptive Character of Thought , 1990 .

[30]  L R Brooks,et al.  The correlation of feature identification and category judgments in diagnostic radiology , 1992, Memory & cognition.

[31]  G. Bower,et al.  Evaluating an adaptive network model of human learning , 1988 .

[32]  Ryszard S. Michalski,et al.  A Theory and Methodology of Inductive Learning , 1983, Artificial Intelligence.

[33]  L. Ross,et al.  Human Inference: Strategies and Shortcomings of Social Judgment. , 1981 .

[34]  L. J. Chapman,et al.  Genesis of popular but erroneous psychodiagnostic observations. , 1967, Journal of abnormal psychology.

[35]  William M. Smith,et al.  A Study of Thinking , 1956 .

[36]  M. McCloskey,et al.  Decision processes in verifying category membership statements: Implications for models of semantic memory , 1979, Cognitive Psychology.

[37]  E. Heit Categorization using chains of examples , 1992, Cognitive Psychology.

[38]  James Kelly,et al.  AutoClass: A Bayesian Classification System , 1993, ML.

[39]  Douglas L Medin,et al.  Linear separability and concept learning: Context, relational properties, and concept naturalness , 1986, Cognitive Psychology.

[40]  Jerome R. Busemeyer,et al.  A New Method for Investigating Prototype Learning , 1988 .

[41]  D. Gentner,et al.  Structural Alignment during Similarity Comparisons , 1993, Cognitive Psychology.

[42]  Raymond J. Mooney,et al.  Induction Over the Unexplained: A New Approach to Combining Empirical andExplanation-Based Learning , 1989 .

[43]  G. V. Nakamura Knowledge-based classification of ill-defined categories , 1985, Memory & cognition.

[44]  G. H. Fisher,et al.  Ambiguity of form: Old and new , 1968 .

[45]  S. Asch Forming impressions of personality. , 1946, Journal of Abnormal Psychology.

[46]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: part 1.: an account of basic findings , 1988 .

[47]  J. Ross Quinlan,et al.  Learning Efficient Classification Procedures and Their Application to Chess End Games , 1983 .

[48]  R. Glaser,et al.  Expertise in a complex skill: Diagnosing x-ray pictures. , 1988 .

[49]  L. E. Bourne,et al.  ATTRIBUTE- AND RULE-LEARNING ASPECTS OF CONCEPTUAL BEHAVIOR. , 1965, Psychological review.

[50]  G. Collins,et al.  Transcending inductive category formation in learning , 1986, Behavioral and Brain Sciences.

[51]  D. Gentner,et al.  Respects for similarity , 1993 .

[52]  R. Nosofsky Exemplars, prototypes, and similarity rules. , 1992 .

[53]  Thomas G. Dietterich,et al.  Learning and Inductive Inference , 1982 .

[54]  Gregory L. Murphy,et al.  Theories and concept formation. , 1993 .

[55]  Jungsoon P. Yoo,et al.  Concept formation over problem-solving experience , 1991 .

[56]  William B Estes,et al.  Similarity , Frequency , and Category Representations , 1988 .

[57]  R. Nosofsky Attention and learning processes in the identification and categorization of integral stimuli. , 1987, Journal of experimental psychology. Learning, memory, and cognition.

[58]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[59]  Steven Minton,et al.  Quantitative Results Concerning the Utility of Explanation-based Learning , 1988, Artif. Intell..

[60]  M. Pazzani,et al.  Concept formation knowledge and experience in unsupervised learning , 1991 .

[61]  Alice F. Healy,et al.  From learning theory to connectionist theory , 1992 .

[62]  R. Nosofsky,et al.  Rules and exemplars in categorization, identification, and recognition. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[63]  Pat Langley,et al.  Data-Driven Discovery of Physical Laws , 1981, Cogn. Sci..