Conceptual knowledge acquisition in search

This paper concerns effective and efficient concept learning in difficult situations, when the data are uncertain and learning must be incremental. The probabilistic learning system PLS is outlined, and some ideas and principles underlying it are developed. PLS1 was the first AI system to use probabilistic conceptual clustering, and to exhibit optimal learning. A new system PLSO may permit tractable induction of structure and relations using “second order” clustering.

[1]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[2]  Richard E. Korf,et al.  Depth-First Iterative-Deepening: An Optimal Admissible Tree Search , 1985, Artif. Intell..

[3]  James R. Slagle,et al.  Experiments With a Multipurpose, Theorem-Proving Heuristic Program , 1968, JACM.

[4]  Edward E. Smith,et al.  Categories and concepts , 1984 .

[5]  J. Gaschnig Performance measurement and analysis of certain search algorithms. , 1979 .

[6]  Claude E. Shannon,et al.  XXII. Programming a Computer for Playing Chess 1 , 1950 .

[7]  D. Hofstadter,et al.  Godel, Escher, Bach: An Eternal Golden Braid , 1979 .

[8]  J. Bruner,et al.  A study of thinking , 1956 .

[9]  Tom M. Mitchell,et al.  Learning from Solution Paths: An Approach to the Credit Assignment Problem , 1982, AI Mag..

[10]  Tom M. Mitchell,et al.  Version Spaces: A Candidate Elimination Approach to Rule Learning , 1977, IJCAI.

[11]  Richard E. Korf,et al.  A Unified Theory of Heuristic Evaluation Functions and its Application to Learning , 1986, AAAI.

[12]  J. Doran,et al.  Experiments with the Graph Traverser program , 1966, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[13]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[14]  C. V. D. Malsburg,et al.  Frank Rosenblatt: Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms , 1986 .

[15]  Henry Hudson XXXI. Proposed method for inferring the dew-point from the indications of the wet-bulb hygrometer , 1835 .

[16]  Nils J. Nilsson,et al.  Problem-solving methods in artificial intelligence , 1971, McGraw-Hill computer science series.

[17]  George F. Luger,et al.  Problem Structure And Problem Solving Behavior , 1975, IJCAI.

[18]  Kenneth de Jong,et al.  Adaptive System Design: A Genetic Approach , 1980, IEEE Trans. Syst. Man Cybern..

[19]  D. Hofstadter Gödel, Escher, Bach , 1979 .

[20]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[21]  Michael R. Anderberg,et al.  Cluster Analysis for Applications , 1973 .

[22]  Philip Klahr,et al.  Cognitive Economy in Artificial Intelligence Systems , 1979, IJCAI.

[23]  L. Rendell An adaptive plan for state-space problems , 1981 .

[24]  Randall Davis,et al.  An overview of production systems , 1975 .

[25]  Larry A. Rendell,et al.  A Doubly Layered, Genetic Penetrance Learning System , 1983, AAAI.

[26]  King-Sun Fu,et al.  Syntactic Pattern Recognition And Applications , 1968 .

[27]  Larry A. Rendell,et al.  Induction, of and by Probability , 1985, UAI.

[28]  Claude E. Shannon,et al.  Programming a computer for playing chess , 1950 .

[29]  Earl D. Sacerdoti,et al.  Planning in a Hierarchy of Abstraction Spaces , 1974, IJCAI.

[30]  Herbert A. Simon,et al.  Problem solving and rule induction: A unified view. , 1974 .

[31]  Tom M. Mitchell,et al.  Models of Learning Systems. , 1979 .

[32]  Satosi Watanabe,et al.  PATTERN RECOGNITION AS INFORMATION COMPRESSION , 1972 .

[33]  T. Anthony Marsland,et al.  A Comparison of Minimax Tree Search Algorithms , 1983, Artif. Intell..

[34]  R. Duda,et al.  Expert Systems Research. , 1983, Science.

[35]  Heinz Werner,et al.  Comparative Psychology of Mental Development , 1942 .

[36]  Jerome A. Feldman,et al.  Decision Theory and Artificial Intelligence: I. A Semantics-Based Region Analyzer , 1974, Artif. Intell..

[37]  Satosi Watanabe,et al.  Pattern Recognition: Human and Mechanical , 1985 .

[38]  D. Bindra A theory of intelligent behavior , 1976 .

[39]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[40]  R. J. Solomonoff,et al.  Inductive inference theory: a unified approach to problems in pattern recognition and artificial intelligence , 1975, IJCAI 1975.

[41]  Ranan B. Banerji,et al.  Artificial Intelligence: A Theoretical Approach , 1980 .

[42]  Charles Hampden-Turner,et al.  Maps of the mind , 1981 .

[43]  Anne Brindle,et al.  Genetic algorithms for function optimization , 1980 .

[44]  Larry A. Rendell,et al.  Toward a Unified Approach for Conceptual Knowledge Acquisition , 1983, AI Mag..

[45]  Larry R. Harris,et al.  The Heuristic Search under Conditions of Error , 1974, Artif. Intell..

[46]  R. Gagne Conditions of Learning , 1965 .

[47]  Ryszard S. Michalski,et al.  Pattern Recognition as Rule-Guided Inductive Inference , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Judea Pearl,et al.  On the Nature of Pathology in Game Searching , 1983, Artif. Intell..

[49]  Hans J. Berliner,et al.  Experiences in Evaluation with BKG - A Program that Plays Backgammon , 1977, IJCAI.

[50]  James R. Slagle,et al.  Experiments in automatic learning for a multipurpose hueristic program , 1971, CACM.

[51]  Arthur L. Samuel,et al.  Some studies in machine learning using the game of checkers" in computers and thought eds , 1995 .

[52]  Tom M. Mitchell,et al.  Learning and Problem Solving , 1983, IJCAI.

[53]  Pat Langley,et al.  Learning Search Strategies through Discrimination , 1983, Int. J. Man Mach. Stud..

[54]  Benjamin Cohen,et al.  Models of Concepts , 1984, Cogn. Sci..

[55]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[56]  Satosi Watanabe,et al.  Knowing and guessing , 1969 .

[57]  A. L. Samuel,et al.  Some studies in machine learning using the game of checkers. II: recent progress , 1967 .

[58]  Judea Pearl Knowledge Versus Search: A Quantitative Analysis Using A* , 1983, Artif. Intell..

[59]  Stephen F. Smith,et al.  A learning system based on genetic adaptive algorithms , 1980 .

[60]  Edward E. Smith,et al.  Concepts and concept formation. , 1984, Annual review of psychology.

[61]  I. Rock The Logic of Perception , 1983 .

[62]  Ronald Christensen,et al.  Foundations of inductive reasoning , 1964 .

[63]  E. Rosch,et al.  Family resemblances: Studies in the internal structure of categories , 1975, Cognitive Psychology.

[64]  Peter C. Cheeseman,et al.  In Defense of Probability , 1985, IJCAI.

[65]  Larry A. Rendell Genetic Plans and the Probabilistic Learning System: Synthesis and Results , 1985, ICGA.

[66]  Larry A. Rendell A General Framework for Induction and a Study of Selective Induction , 1986, Mach. Learn..

[67]  Hans J. Berliner,et al.  Some Necessary Conditions for a Master Chess Program , 1973, IJCAI.

[68]  Arthur Gill Applied algebra for the computer sciences , 1976 .

[69]  Keith Price,et al.  Review of "Artificial Intelligence: A Theoretical Approach by Ranan B. Banerji", North Holland, NY. , 1980, SGAR.

[70]  Larry A. Rendell,et al.  Substantial Constructive Induction Using Layered Information Compression: Tractable Feature Formation in Search , 1985, IJCAI.

[71]  George W. Ernst,et al.  Mechanical Discovery of Classes of Problem-Solving Strategies , 1982, JACM.

[72]  Michael P. Georgeff Strategies in Heuristic Search , 1983, Artif. Intell..

[73]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[74]  Richard Fikes,et al.  Learning and Executing Generalized Robot Plans , 1993, Artif. Intell..

[75]  K. Holyoak,et al.  Alternative conceptions of semantic theory , 1975, Cognition.

[76]  Rina Dechter,et al.  Probabilistic Analysis of the Complexity of A* , 1980, Artif. Intell..

[77]  Nils J. Nilsson,et al.  Principles of Artificial Intelligence , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[78]  Larry A. Rendell,et al.  A New Basis for State-Space Learning Systems and a Successful Implementation , 1983, Artif. Intell..

[79]  R. Gagne,et al.  Contributions of learning to human development. , 1968, Psychological review.

[80]  Jaime G. Carbonell,et al.  Machine Learning: A Historical and Methodological Analysis , 1983, AI Mag..

[81]  Ivan Bratko,et al.  An Advice Program for a Complex Chess Programming Task , 1980, Comput. J..

[82]  A. A. Mullin,et al.  Principles of neurodynamics , 1962 .

[83]  O. G. Selfridge,et al.  Pandemonium: a paradigm for learning , 1988 .

[84]  J. Ross Quinlan,et al.  Learning Efficient Classification Procedures and Their Application to Chess End Games , 1983 .

[85]  John Eliot,et al.  Human development and cognitive processes , 1970 .

[86]  Bruce G. Buchanan,et al.  Dendral and Meta-Dendral: Their Applications Dimension , 1978, Artif. Intell..

[87]  R.B. Banerji Theory of problem solving: A branch of artificial intelligence , 1982, Proceedings of the IEEE.

[88]  Sylvian R. Ray,et al.  Rule Refinement Using the Probabilistic Rule Generator , 1986, AAAI.

[89]  Ranan B. Banerji Some linguistic and statistical problems in pattern recognition , 1970, Pattern Recognit..

[90]  Dana S. Nau,et al.  Pathology on Game Trees Revisited, and an Alternative to Minimaxing , 1983, Artif. Intell..

[91]  Norman R. Draper,et al.  Applied regression analysis (2. ed.) , 1981, Wiley series in probability and mathematical statistics.

[92]  Ryszard S. Michalski,et al.  A Theory and Methodology of Inductive Learning , 1983, Artificial Intelligence.

[93]  Thomas G. Dietterich,et al.  A Comparative Review of Selected Methods for Learning from Examples , 1983 .

[94]  Douglas B. Lenat,et al.  The Nature of Heuristics , 1982, Artif. Intell..

[95]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[96]  John A. Hartigan,et al.  Clustering Algorithms , 1975 .

[97]  Hans J. Berliner,et al.  On the Construction of Evaluation Functions for Large Domains , 1979, IJCAI.

[98]  L. Uhr,et al.  Computers in the study of learning: BOGART—A discovery and induction program for games , 1965, ACM '65.

[99]  R. Banerji Learning to Solve Games and Puzzles , 1976 .

[100]  Patrick Henry Winston,et al.  Artificial intelligence (2nd ed.) , 1984 .

[101]  Satosi Watanabe PATTERN RECOGNITION AS AN INDUCTIVE PROCESS , 1969 .

[102]  D Marr,et al.  Early processing of visual information. , 1976, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.