Machine Learning from Examples: A Non-Inductivist Analysis

It has been suggested that AI investigations of mechan- ical learning undermine sweeping anti-inductivist views in the theory of knowledge and the philosophy of science. In particular, it is claimed that some mechanical learning systems perform epistemically justified inductive generalization and prediction. Contrary to this view, it is ar- gued that no trace of such epistemic justification is to be found within a rather representative class of learning agents drawn from machine learning and robotics. Moreover, an alternative deductive account of these learning procedures is outlined. Finally, the opportunity of de- veloping an induction-free logical analysis of non-monotonic reason- ing in autonomous learning agents - capable of advancing and revising learning or background hypotheses - is emphasized by a broad reflec- tion on some families of non-monotonic, albeit deductive, consequence relations. 1

[1]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[2]  C. Howson Hume's problem: induction and the justification of belief , 2000 .

[3]  Nick Chater,et al.  Commonsense reasoning, logic, and human rationality , 2002 .

[4]  Daniel Lehmann,et al.  What does a Conditional Knowledge Base Entail? , 1989, Artif. Intell..

[5]  Jeff B. Paris Common Sense and Maximum Entropy , 2004, Synthese.

[6]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[7]  Sarit Kraus,et al.  Nonmonotonic Reasoning, Preferential Models and Cumulative Logics , 1990, Artif. Intell..

[8]  Joseph Y. Halpern,et al.  Plausibility measures and default reasoning , 1996, JACM.

[9]  Ryszard S. Michalski,et al.  A theory and methodology of inductive learning , 1993 .

[10]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[11]  Gabriele Kern-Isberner,et al.  Conditionals in Nonmonotonic Reasoning and Belief Revision: Considering Conditionals as Agents , 2001 .

[12]  P G rdenfors,et al.  Knowledge in flux: modeling the dynamics of epistemic states , 1988 .

[13]  E. Davis,et al.  Common Sense Reasoning , 2014, Encyclopedia of Social Network Analysis and Mining.

[14]  Peter Gärdenfors Nonmonotonic Inferences Based on Expectations: A Preliminary Report , 1991, KR.

[15]  Russell J. Clark,et al.  Case-based reactive navigation: a method for on-line selection and adaptation of reactive robotic control parameters , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[16]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[17]  David Makinson,et al.  General Theory of Cumulative Inference , 1988, NMR.

[18]  K. Popper Objective Knowledge: An Evolutionary Approach , 1972 .

[19]  Christoph Beierle,et al.  Using Institutions for the Study of Qualitative and Quantitative Conditional Logics , 2002, JELIA.

[20]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[21]  Peter Gärdenfors,et al.  On the logic of theory change: Partial meet contraction and revision functions , 1985, Journal of Symbolic Logic.

[22]  John Woods,et al.  Standard logics as theories of argument and inference: Induction , 2002 .

[23]  George A. Bekey,et al.  A reinforcement-learning approach to reactive control policy design for autonomous robots , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[24]  Alexander Bochman,et al.  A Logical Theory of Nonmonotonic Inference and Belief Change , 2001, Artificial Intelligence.

[25]  Daniel Lehmann,et al.  Nonmonotonic inference operations , 1993, Log. J. IGPL.

[26]  Peter Gärdenfors,et al.  Relations between the logic of theory change and nonmonotonic logic , 1989, The Logic of Theory Change.

[27]  David Makinson,et al.  Bridges between Classical and Nonmonotonic Logic , 2003, Log. J. IGPL.

[28]  Peter A. Flach,et al.  Modern Logic and its Role in the Study of Knowledge , 2007 .

[29]  Jeff B. Paris,et al.  A Note on the Rational Closure of Knowledge Bases with Both Positive and Negative Knowledge , 1998, J. Log. Lang. Inf..

[30]  Russell J. Clark,et al.  Learning momentum: online performance enhancement for reactive systems , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[31]  Donald Gillies,et al.  Artificial intelligence and scientific method , 1996 .

[32]  Dov M. Gabbay,et al.  Theoretical Foundations for Non-Monotonic Reasoning in Expert Systems , 1989, Logics and Models of Concurrent Systems.

[33]  Hans Rott,et al.  Change, choice and inference - a study of belief revision and nonmonotonic reasoning , 2001, Oxford logic guides.

[34]  Jeff B. Paris,et al.  When Maximizing Entropy gives the Rational Closure , 2003, J. Log. Comput..

[35]  Guglielmo Tamburrini Artificial intelligence and Popper's solution to the problem of induction , 2006 .

[36]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[37]  J. Paris The Uncertain Reasoner's Companion: A Mathematical Perspective , 1994 .

[38]  David Makinson,et al.  General patterns in nonmonotonic reasoning , 1994 .

[39]  Sridhar Mahadevan,et al.  Automatic Programming of Behavior-Based Robots Using Reinforcement Learning , 1991, Artif. Intell..

[40]  Ulrich Nehmzow,et al.  The Prospective Student's Introduction to the Robot Learning Problem , 1995 .