Experiments with Incremental Concept Formation: UNIMEM

Learning by observation involves automatic creation of categories that summarize experience. In this paper we present UNIMEM, an artificial intelligence system that learns by observation. UNIMEM is a robust program that can be run on many domains with real-world problem characteristics such as uncertainty, incompleteness, and large numbers of examples. We give an overview of the program that illustrates several key elements, including the automatic creation of non-disjoint concept hierarchies that are evaluated over time. We then describe several experiments that we have carried out with UNIMEM, including tests on different domains (universities, Congressional voting records, and terrorist events) and an examination of the effect of varying UNIMEM's parameters on the resulting concept hierarchies. Finally we discuss future directions for our work with the program.

[1]  E. Feigenbaum.  The simulation of verbal learning behavior , 1899, IRE-AIEE-ACM '61 (Western).

[2]  E. Feigenbaum,et al.  Computers and Thought , 1963 .

[3]  Marvin Minsky,et al.  Semantic Information Processing , 1968 .

[4]  H. R. Quillian.  In semantic information processing , 1968 .

[5]  Patrick Henry Winston,et al.  Learning structural descriptions from examples , 1970 .

[6]  Michael R. Anderberg,et al.  Cluster Analysis for Applications , 1973 .

[7]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[8]  Marvin Minsky,et al.  A framework for representing knowledge" in the psychology of computer vision , 1975 .

[9]  Patrick Henry Winston,et al.  The psychology of computer vision , 1976, Pattern Recognit..

[10]  Janet L. Kolodner,et al.  Retrieval and organizational strategies in conceptual memory: a computer model , 1980 .

[11]  Michael Lebowitz,et al.  Generalization and memory in an integrated understanding system , 1980 .

[12]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[13]  Michael Lebowitz,et al.  RESEARCHER: An Overview , 1983, AAAI.

[14]  Michael Lebowitz.  Classifying Numeric Information for Generalization , 1983 .

[15]  Ryszard S. Michalski,et al.  Automated Construction of Classifications: Conceptual Clustering Versus Numerical Taxonomy , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  C SchankRoger,et al.  Dynamic Memory: A Theory of Reminding and Learning in Computers and People , 1983 .

[17]  Michael Lebowitz,et al.  Generalization From Natural Language Text , 1983, Cogn. Sci..

[18]  Michael Lebowitz,et al.  Memory-Based Parsing , 1983, Artif. Intell..

[19]  Janet L. Kolodner,et al.  Retrieval and Organizational Strategies in Conceptual Memory (Ple: Memory): A Computer Model , 1984 .

[20]  John R. Anderson,et al.  MACHINE LEARNING An Artificial Intelligence Approach , 2009 .

[21]  Ronald J. Brachman,et al.  "I Lied About the Trees", Or, Defaults and Definitions in Knowledge Representation , 1985, AI Mag..

[22]  Thomas G. Dietterich,et al.  Learning to Predict Sequences , 1985 .

[23]  Michael Lebowitz,et al.  An Experiment in Intelligent Information Systems: RESEARCHER , 1985 .

[24]  Mark A. Gluck,et al.  Information, Uncertainty and the Utility of Categories , 1985 .

[25]  Pat Langley,et al.  Approaches to Conceptual Clustering , 1985, IJCAI.

[26]  Michael Lebowitz.  Categorizing numeric information for generalization , 1985 .

[27]  Michael Lebowitz,et al.  Not the Path to Perdition: The Utility of Similarity-Based Learning , 1986, AAAI.

[28]  Michael Lebowitz,et al.  Integrated Learning: Controlling Explanation , 1986, Cogn. Sci..

[29]  Ryszard S. Michalski,et al.  Conceptual Clustering: Inventing Goal-Oriented Classifications of Structured Objects , 1986 .

[30]  Tom Michael Mitchell,et al.  Explanation-based generalization: A unifying view , 1986 .

[31]  Roger C. Schank,et al.  Explanation Patterns: Understanding Mechanically and Creatively , 1986 .

[32]  P. Ut Goff,et al.  Machine learning of inductive bias , 1986 .

[33]  Andrea Pohoreckyj Danyluk,et al.  The Use of Explanations for Similarity-based Learning , 1987, IJCAI.

[34]  H. Chertkow,et al.  Semantic memory , 2002, Current neurology and neuroscience reports.

[35]  R. Mooney,et al.  Explanation-Based Learning: An Alternative View , 1986, Machine Learning.

[36]  Douglas H. Fisher,et al.  Knowledge Acquisition Via Incremental Conceptual Clustering , 1987, Machine Learning.