Machine Learning. Part 1. A Historical and Methodological Analysis.

Abstract : Machine learning has always been an integral part of artificial intelligence, and its methodology has evolved in concert with the major concerns of the field. In response to the difficulties of encoding ever-increasing volumes of knowledge in modern Al systems, many researchers have recently turned their attention to machine learning as a means to overcome the knowledge acquisition bottleneck. Part 1 of this paper presents a taxonomic analysis of machine learning organized primarily by learning strategies and secondarily by knowledge representation and application areas. A historical survey outlining the development of various approaches to machine learning is presented from early neural networks to present knowledge intensive techniques. Part II (to be published in a subsequent issue) will outline major present research directions, and suggest viable areas for future investigation.

[1]  Ya Tsypkin,et al.  Self-learning--What is it? , 1968 .

[2]  Frederick Hayes-Roth,et al.  An interference matching technique for inducing abstractions , 1978, CACM.

[3]  Michael D. Rychener.  THE INSTRUCTIBLE PRODUCTION SYSTEM: A RETROSPECTIVE ANALYSIS , 1983 .

[4]  Carl,et al.  PROGRAMMING A MODEL OF HUMAN CONCEPT , 2022 .

[5]  Douglas B. Lenat.  9 – THE ROLE OF HEURISTICS IN LEARNING BY DISCOVERY: THREE CASE STUDIES , 1983 .

[6]  Ryszard S. Michalski,et al.  A Variable-Valued Logic System as Applied to Picture Description and Recognition , 1972 .

[7]  Ryszard S. Michalski,et al.  AQVAL/1--Computer Implementation of a Variable-Valued Logic System VL1 and Examples of its Application to Pattern Recognition , 1973, IJCAI 1973.

[8]  Douglas B. Lenat,et al.  The Role of Heuristics in Learning by Discovery: Three Case Studies , 1983 .

[9]  B. Widrow,et al.  Generalization and information storage in network of adaline 'neurons' , 1962 .

[10]  Kumpati S. Narendra,et al.  Adaptation and learning in automatic systems , 1974 .

[11]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[12]  Tom Michael Mitchell.  Version spaces: an approach to concept learning. , 1979 .

[13]  Douglas B. Lenat,et al.  AM, an artificial intelligence approach to discovery in mathematics as heuristic search , 1976 .

[14]  Derek Sleeman.  INFERRING STUDENT MODELS FOR INTELLIGENT COMPUTER-AIDED INSTRUCTION , 1983 .

[15]  FREDERICK HAYES-RoTH,et al.  Schematic classification problems and their solution , 1974, Pattern Recognit..

[16]  Arthur L. Samuel,et al.  Some Studies in Machine Learning Using the Game of Checkers , 1967, IBM J. Res. Dev..

[17]  R. Michalski,et al.  Learning from Observation: Conceptual Clustering , 1983 .

[18]  L. Weinberg,et al.  Automatic Feedback Control System Synthesis , 1956 .

[19]  Michael Satosi Watanabe,et al.  Information-Theoretical Aspects of Inductive and Deductive Inference , 1960, IBM J. Res. Dev..

[20]  Karl Steinbuch,et al.  Adaptive Systems in Pattern Recognition , 1963, IEEE Trans. Electron. Comput..

[21]  I︠a︡. Z. T︠S︡ypkin,et al.  Foundations of the theory of learning systems , 1973 .

[22]  S. Vere.  Induction of concepts in the predicate calculus , 1975, IJCAI 1975.

[23]  Patrick Henry Winston,et al.  Learning and reasoning by analogy , 1980, CACM.

[24]  Allen and Rosenbloom Paul S. Newell,et al.  Mechanisms of Skill Acquisition and the Law of Practice , 1993 .

[25]  J. Ross Quinlan,et al.  Learning Efficient Classification Procedures and Their Application to Chess End Games , 1983 .